-- Logs begin at Thu 2022-05-26 12:59:23 UTC, end at Thu 2022-05-26 14:18:32 UTC. -- May 26 13:46:52.041081 dv-cinder-842130-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 13:46:52.054101 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 13:46:52.064380 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 13:46:52 2022] *** May 26 13:46:52.064380 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 13:46:52.064380 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 13:46:52.064380 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: nodename: dv-cinder-842130-1-iscsi May 26 13:46:52.064380 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: machine: x86_64 May 26 13:46:52.064380 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: clock source: unix May 26 13:46:52.064380 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: pcre jit disabled May 26 13:46:52.064380 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: detected number of CPU cores: 4 May 26 13:46:52.064380 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: current working directory: / May 26 13:46:52.064380 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: detected binary path: /usr/bin/uwsgi-core May 26 13:46:52.065094 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: your processes number limit is 47680 May 26 13:46:52.065094 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: your memory page size is 4096 bytes May 26 13:46:52.065094 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: detected max file descriptor number: 2048 May 26 13:46:52.065094 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: lock engine: pthread robust mutexes May 26 13:46:52.065094 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: thunder lock: enabled May 26 13:46:52.065094 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 13:46:52.065094 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 13:46:52.108414 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: Python main interpreter initialized at 0x557d2adc49c0 May 26 13:46:52.108414 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: python threads support enabled May 26 13:46:52.108414 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: your server socket listen backlog is limited to 100 connections May 26 13:46:52.108414 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: your mercy for graceful operations on workers is 90 seconds May 26 13:46:52.108805 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: mapped 403077 bytes (393 KB) for 2 cores May 26 13:46:52.108805 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: *** Operational MODE: preforking *** May 26 13:46:52.109065 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: *** uWSGI is running in multiple interpreter mode *** May 26 13:46:52.109065 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: spawned uWSGI master process (pid: 103106) May 26 13:46:52.109266 dv-cinder-842130-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 13:46:52.109855 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: spawned uWSGI worker 1 (pid: 103107, cores: 1) May 26 13:46:52.110153 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: spawned uWSGI worker 2 (pid: 103108, cores: 1) May 26 13:46:52.113180 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 13:46:53.287780 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 13:46:53.321179 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 13:46:54.023850 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 13:46:54.023850 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: from cryptography.utils import int_from_bytes May 26 13:46:54.024186 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 13:46:54.024186 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: from cryptography.utils import int_from_bytes May 26 13:46:54.031640 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 13:46:54.031640 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: from cryptography.utils import int_from_bytes May 26 13:46:54.031980 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 13:46:54.031980 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: from cryptography.utils import int_from_bytes May 26 13:46:56.620170 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 13:46:56.620840 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 13:46:56.621021 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 13:46:56.621096 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 13:46:56.621471 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 13:46:56.621556 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 13:46:56.621632 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 13:46:56.621807 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 13:46:56.621899 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.622138 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 13:46:56.622236 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.622388 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 13:46:56.622482 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.622768 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.622858 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.623094 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.623239 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.623404 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.623506 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.623723 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.623811 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.624046 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.624185 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.624373 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.624475 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.624638 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.624803 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.624971 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.625098 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.625283 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842130-1-iscsi {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.625374 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.625600 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.625686 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.625903 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.625995 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.626215 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.626376 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842130-1-iscsi {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.626534 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.626682 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.626808 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.626893 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.627116 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.627231 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.627418 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.627508 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.627729 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.627917 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.628318 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.628318 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.628548 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.628659 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.628823 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.628959 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.629131 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.629268 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.629459 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.629584 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.629767 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.629894 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.630100 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.630230 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.630418 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.630513 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.630724 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.630823 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.631039 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.631135 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.631345 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.631480 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842130-1-iscsi {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.631661 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.631795 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.631964 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.632107 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.632355 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842130-1-iscsi {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.632449 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.632667 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.632818 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.632974 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.633131 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.633311 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.633464 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.633723 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.633812 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.634031 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.634130 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.634340 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.634448 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.634657 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.634751 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.634975 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.635061 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.635278 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.635378 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.635601 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.635688 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.635898 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.635994 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.636205 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.636303 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.637082 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.637251 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.637498 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.637585 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.637809 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.637899 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.638115 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.638204 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.638363 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.638450 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.638670 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.638758 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.638994 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.639079 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.639261 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.639356 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.639566 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.639663 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.639854 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.639941 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.640102 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.640198 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.640420 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.640511 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.640731 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.640869 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.640960 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.641042 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.641306 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.641399 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.641624 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.641724 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.641930 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.642019 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.642231 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.642317 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.642531 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.642625 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.642842 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.642942 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.643126 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.643211 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.643426 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.643528 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.643726 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.643813 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.644026 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.644120 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.644349 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.644497 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.644644 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.644730 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.644960 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.645098 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.91 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.645293 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.91 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.645394 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.645601 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.645688 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.645939 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.646027 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.91 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.646228 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.91 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.646321 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.646532 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.646619 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.646852 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.646945 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.647170 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.647261 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.647474 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.647566 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.647776 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.647864 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.648080 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.648168 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.648385 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.648477 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.648687 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.648779 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.648990 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.649078 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.649257 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.649346 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.649559 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.649663 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.649865 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.649963 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.650161 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.650247 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.650460 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.650555 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.650762 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.650855 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.651065 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.651152 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.651363 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.651459 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.651663 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.651756 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.651964 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.652063 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.652848 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.652950 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.653172 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.653263 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.653482 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.653580 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.653784 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.653882 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.654084 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.654170 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.654385 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.654471 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.654684 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.654778 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.654987 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.655074 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.655288 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.655379 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.655588 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.655676 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.655885 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.655970 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.656187 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.656287 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.656490 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.656590 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.656788 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.656877 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.657088 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.657210 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.657417 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.657517 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.657764 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.657875 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.658034 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.658193 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.658320 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.658461 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.658735 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.658865 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.659054 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.659171 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.659356 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.659453 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.659671 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.659759 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.659970 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.660056 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.660276 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.660373 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.660588 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.660674 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.660883 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.660970 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.661208 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.661302 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.661511 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.661595 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.661812 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.661913 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.662112 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.662206 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.662408 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.662506 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.662704 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.662804 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.663003 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.663095 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.663301 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.663386 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.663598 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.663694 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.663895 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.663981 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.664191 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.664279 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.664505 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.664619 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.664810 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.664906 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.665112 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.665212 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.665444 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.665541 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.665745 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.665839 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.666062 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:46:56.666161 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.666394 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.666483 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.666978 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.667070 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.667304 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.667389 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.667634 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.667723 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.667957 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.668059 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.668268 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.668378 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.668592 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.668680 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.668901 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.668989 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.669231 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.669341 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.669543 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.669642 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.669856 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.669941 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.670169 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.670262 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.670477 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.670569 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.670793 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.670894 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.671103 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.671202 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.671416 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.671513 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.671724 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.671818 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.672037 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.672131 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.672354 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.672442 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.672661 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.672747 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.672966 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.673063 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.673323 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.673456 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.673647 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.673739 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.673955 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.674054 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.674275 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.674363 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.674593 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.674691 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.674919 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.675055 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.675246 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.675364 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.675559 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.675690 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.675876 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.676002 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.676208 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.676295 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.676518 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.676605 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.676831 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.676920 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.677137 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.677275 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.677464 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.677560 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.677770 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.677860 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.678075 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.678163 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.678384 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.678483 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.678715 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.678805 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.679025 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.679111 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.679329 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.679427 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.679633 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.679720 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.679943 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.680029 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.680248 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.680349 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.680554 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.680649 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.680861 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.680947 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.681176 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.681280 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.681483 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.681571 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.681786 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.681886 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.682087 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.682189 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.682383 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.682475 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.682681 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.682766 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.682985 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.683074 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.683826 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.684095 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.684194 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.684437 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.684536 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.684740 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.684834 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.685047 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.685134 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.685377 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.685483 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.685681 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.685771 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.685983 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.686068 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.686285 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.686387 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.686586 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.686674 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.686888 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.686974 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.687190 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.687278 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.687492 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.687580 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.687793 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.687879 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.688104 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.688191 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.688410 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.688532 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.688711 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.688812 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.689012 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.689109 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.689338 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.689436 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.689644 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.689742 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.689949 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.690077 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.690249 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.690347 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.690553 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.690658 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.690874 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.691020 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.691182 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.691318 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.691520 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.691689 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.691847 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.691944 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.692153 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.692314 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.692476 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.692576 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.692798 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.692885 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.693113 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.693223 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.693440 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.693538 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.693748 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.693836 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.694049 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.694142 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.694348 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.694436 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.694647 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.694731 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.694946 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.695032 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.695246 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.695340 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.695547 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.695642 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.695842 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.695928 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.696139 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.696226 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.696434 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.696529 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.696734 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.696861 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.697031 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.697180 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.697361 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.697482 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.697663 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.697834 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.697962 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.698048 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.698262 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.698348 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.698565 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.698688 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.698938 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.699544 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.699792 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.699886 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.700140 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.700245 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.700474 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.700574 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.700784 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.700939 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.701104 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.701304 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.701458 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.701611 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.701771 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.701869 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.702082 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.702171 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.702393 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.702487 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.702711 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.702807 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.703021 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.703109 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.703338 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.703426 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.703644 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.703730 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.703958 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.704045 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.704268 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.704355 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.704585 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.704670 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.704890 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.704979 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.705225 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.705330 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.705529 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.705617 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.705843 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.705932 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.706180 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.706271 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.706499 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.706594 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.706810 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.706904 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.707123 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.707210 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.707428 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.707528 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.707736 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.707828 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.708038 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.708124 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.708345 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.708476 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.708668 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.708766 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.708950 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.709037 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.709284 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.709382 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.709591 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.709676 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.709903 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.709997 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.710208 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.710284 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.710522 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.710607 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.710823 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.710908 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.711137 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.711225 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.711432 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.711518 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.711740 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.711826 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.712063 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.712151 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.712371 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.712455 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.712680 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.712755 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.712988 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.713076 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.713320 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.713406 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.713628 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.713718 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.713939 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.714016 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.714301 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.714375 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.715151 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.715326 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.715468 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.715770 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.715846 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.716074 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.716155 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.716378 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.716455 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.716690 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.716766 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.716998 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.717073 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.717323 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.717404 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.717627 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.717741 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.717939 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.718163 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.718278 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.718474 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.718558 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.718787 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.718912 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.719099 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.719213 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.719423 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.719523 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.719739 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.719846 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.720058 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.720186 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.720365 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.720514 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.720671 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.720811 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.720972 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.721195 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.721344 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.721506 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.721639 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.721756 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.721922 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.722053 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.722222 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.722323 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.722542 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.722689 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.722860 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.722974 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.723174 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.723308 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.723483 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.723630 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.723794 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.723927 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.724103 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.724216 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.724410 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.724543 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.724719 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.724841 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.725023 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.725550 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.725550 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.725810 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.725810 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.726067 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.726213 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.726358 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.726508 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.726653 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.726784 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.726914 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.727068 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.727204 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.727355 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.727471 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.727587 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.727768 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.727917 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.728195 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.728406 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.728528 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.728658 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.729047 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.729207 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.729437 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.729580 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.729807 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.729919 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.730202 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.730842 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.731045 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.731197 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.731362 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.731805 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.731942 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.732185 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.732336 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.732533 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.732665 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.732844 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.733084 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.733225 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.733444 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.733553 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.733775 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.733968 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.734118 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.734378 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.734518 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.734686 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.734813 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.734991 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.735171 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.735293 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.735594 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.735709 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.735893 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.736010 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.736196 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.736372 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.736487 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.736745 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.736854 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.737093 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.737265 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.737425 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.737561 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.737730 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.737852 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.738057 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.738195 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.738358 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.738547 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.738645 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.738898 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.739044 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.739243 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.739403 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.739590 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.739742 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.739886 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.739999 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.740214 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.740334 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.740542 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.740661 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.740883 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.741002 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.741208 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.741303 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.741519 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.741650 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.741845 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.741970 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.742145 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.742260 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.742446 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.742639 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.742742 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.743006 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.743104 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.743332 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.743442 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.743634 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.743749 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.743945 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.744164 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.744254 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.744545 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.744678 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.744845 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.744935 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.745145 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.745281 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.745476 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.745564 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.746340 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.746437 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.746658 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.746756 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.746966 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.747053 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.747268 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.747353 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.747565 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.747664 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.747873 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.748005 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.748173 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.748259 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.748470 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.748565 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.748774 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.748864 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.749073 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.749181 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.749411 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.749513 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.749714 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.749801 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.750016 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.750105 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.750316 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.750411 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.750619 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.750705 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.750923 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.751008 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.751221 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.751316 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.751517 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.751602 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.751823 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.751914 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.752129 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.752273 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.752413 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.752560 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.752722 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.752881 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.753035 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.753135 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.753334 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.753479 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.753625 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.753753 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.753939 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.754252 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.754420 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.754545 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.754647 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.754851 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.754953 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.755152 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.755248 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.755452 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.755541 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.755750 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.755840 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.756054 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.756142 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.756353 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.756443 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.756657 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.756780 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.756950 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.757101 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.757381 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.757553 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.757645 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.757870 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.758084 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.758172 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.758409 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.758517 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.758736 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.758824 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.759036 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.759165 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.759345 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.759445 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.759655 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.759750 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.759964 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.760052 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.760267 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.760367 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.760568 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.760662 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.760879 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.761037 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.761214 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.761304 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.762099 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.762196 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.762402 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.762489 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.762702 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.762789 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.763001 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.763087 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.763310 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.763395 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.763618 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.763705 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.763917 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.764012 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.764216 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.764309 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.764518 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.764606 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.764829 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.764914 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.765136 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.765261 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.765476 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.765563 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.765798 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.765884 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.766109 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.766206 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.766410 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.766497 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.766718 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.766805 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.767023 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.767117 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.767326 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.767412 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.767630 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.767714 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.767934 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.768028 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.768244 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.768343 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.768550 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.768639 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.768851 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.768945 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.769219 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.769406 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.769494 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.769623 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.769778 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.769940 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.770083 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.770251 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.770389 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.770573 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.770678 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.770897 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.770985 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.771220 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.771307 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.771522 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.771617 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.771829 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.771916 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.772139 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.772273 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.772447 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.772536 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.772745 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.772829 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.773177 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.773266 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.773496 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.773585 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.773803 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.773912 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.774104 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.774314 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.774410 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.774631 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.774726 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.774943 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.775030 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.775250 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.775345 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.775560 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.775647 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.775869 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.775995 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.776175 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.776312 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.776497 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.776623 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.776806 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.776933 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.777163 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.777350 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.777490 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.777613 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.777801 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.777947 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.778083 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.778205 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.778392 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.778537 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.778766 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.778858 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.779071 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.779154 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.779400 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.779490 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.779688 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.779786 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.780006 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.780092 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.780316 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.780411 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.780629 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.780726 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.780948 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.781078 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.781270 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.781430 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.781688 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.781837 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.782000 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.782088 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.782308 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.782420 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.782619 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.782778 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.782918 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.783006 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.783218 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.783306 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.783525 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.783623 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.783829 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.783917 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.784134 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.784249 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.784455 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.784544 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.784719 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.784806 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.785035 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.785121 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.785366 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.785464 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.785684 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.785781 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.786001 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.786108 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.786312 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.786408 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.786628 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.786718 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.787042 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.787130 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.787362 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.787456 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.787667 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.787755 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.787985 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.788073 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.788303 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.788413 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.788606 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.788714 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.788904 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.788992 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.789233 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.789347 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.789537 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.789627 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.789840 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.789937 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.790162 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.790263 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.790463 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.790550 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.790772 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.790859 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.791077 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.791172 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.791384 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.791471 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.791939 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.792033 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.792239 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.792329 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.792557 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.792678 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.792883 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.793010 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.793223 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.793359 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.793542 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.793695 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.793858 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.793977 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.794181 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.794302 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.794483 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.794607 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.794804 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.794899 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.795109 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.795201 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.795410 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.795498 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.795711 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.795808 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.796011 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.796098 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.796350 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.796437 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.796652 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.796748 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.796954 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.797052 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.797282 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.797386 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.797586 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.797704 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.797885 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.797973 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.798203 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.798290 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.798505 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.798601 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.798823 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.798923 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.799138 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.799244 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.799450 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.799539 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.799754 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.799844 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.800058 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.800146 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.800368 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.800501 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.800672 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.800806 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.800963 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.801107 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.801294 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.801445 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.801590 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.801700 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.801856 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.802018 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.802155 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.802320 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.802454 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.802635 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.802773 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.803255 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.803401 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.803535 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.803696 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.803793 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.803874 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.804051 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.804141 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.804357 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.804444 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.804659 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.804746 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.805000 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.805095 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.805323 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.805427 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.805636 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.805722 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.805966 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.806075 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.806235 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.806322 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.806533 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.806634 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.806831 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.806920 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.807129 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.807216 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.807434 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.807532 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.807733 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.807829 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.808032 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.808126 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.808861 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.808971 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.809189 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.809330 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.809499 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.809585 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.809809 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.809908 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.810112 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.810200 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.810417 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.810504 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.810717 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.810806 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.811016 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.811103 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.811353 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.811570 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.811668 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.811896 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.811984 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.812269 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.812364 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.812586 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.812686 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.812909 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.812996 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.813235 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.813341 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.813559 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.813670 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.813868 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.813957 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.814175 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.814263 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.814485 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.814575 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.814792 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.814881 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.815100 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.815187 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.815408 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.815505 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.815716 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.815804 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.816019 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.816107 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.816329 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.816419 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.816638 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.816732 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.817036 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.817144 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.817488 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.817637 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.817878 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.817957 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.818198 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.818285 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.818506 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.818583 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.818819 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.818895 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.819135 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.819219 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.819439 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.819514 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.819745 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.819823 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.820052 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.820129 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.820353 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.820427 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.820658 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.820741 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.820964 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.821040 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.821294 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.821376 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.821606 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.821682 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.821916 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.821995 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.822229 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.822304 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.822538 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.822623 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.822846 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.822922 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.823154 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.823230 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.823461 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.823563 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.823776 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.823887 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.824694 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.824900 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.825057 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.825241 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.825321 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.825580 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.825656 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.825908 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.825996 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.826387 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.826474 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.826543 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.826609 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.826814 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.826914 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.827123 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.827199 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.827430 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.827506 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.827733 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.827817 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.828041 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.828124 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.828346 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.828434 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.828648 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.828739 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.828969 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.829063 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.829302 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.829393 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.829608 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.829699 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.829923 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.830009 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.830228 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.830442 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.830754 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.830843 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.831082 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.831170 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.831400 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.831544 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.831719 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.831807 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.832033 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.832120 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.832349 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.832515 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.832676 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.832809 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.832954 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.833040 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.833277 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.833383 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.833580 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.833669 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.833882 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.833971 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.834185 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.834281 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.834484 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.834570 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.834790 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.834881 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.835088 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.835176 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.835389 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.835475 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.835689 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.835775 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.835995 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.836215 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.836312 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.836567 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.836655 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.836885 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.836982 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.837202 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.837291 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.837507 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.837595 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.837819 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.837920 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.838123 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.838210 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.838425 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.838512 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.838726 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.838815 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.839027 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.839114 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.839335 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.839423 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.839659 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.839750 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.839967 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.840053 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.840268 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.840355 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.840575 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.840663 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.840873 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.841009 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.841197 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.841303 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.841501 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.841631 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.841848 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.842013 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.842137 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.842284 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.842437 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.842543 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.842748 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.842843 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.843056 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.843152 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.843377 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.843465 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.843687 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.843774 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.843995 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.844092 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.844296 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.844383 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.844598 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.844712 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.844907 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.845181 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.845286 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.845519 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.845607 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.845817 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.845917 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.846128 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.846216 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.846432 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.846527 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.846739 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.846840 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.847049 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.847136 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.847354 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.847440 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.847676 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.847771 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.847975 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.848061 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.848279 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.848364 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.848584 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.848683 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.848888 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.848974 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.849223 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.849312 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.849531 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.849619 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.849837 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.849924 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.850141 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.850228 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.850451 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.850700 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.850846 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.851024 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.851113 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.851336 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.851433 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.851647 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.851769 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.851960 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.852062 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.852263 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.852352 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.852566 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.852662 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.852870 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.852958 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.853211 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.853304 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.853519 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.853607 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.853825 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.853912 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.854130 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.854220 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.854433 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.854518 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.854735 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.854821 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.855039 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.855148 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.855389 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.855476 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.855694 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.855806 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.855996 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.856090 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.856298 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.856416 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.856603 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.856727 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.856910 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.857041 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.857236 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.857388 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.857552 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.857694 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.857894 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.857995 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.858211 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.858300 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.858525 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.858621 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.858837 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.858925 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.859150 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.859237 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.859457 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.859553 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.859769 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.859857 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.860075 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.860164 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.860379 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.860468 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.860690 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.860777 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.861014 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.861120 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.861344 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.861432 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.861646 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.861860 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.861951 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.862066 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.862253 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.862378 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.862556 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.862691 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.862857 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.863152 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.863245 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.863452 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.863553 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.863748 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.863845 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.864048 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.864138 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.864349 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.864440 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.864660 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.864756 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.864960 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.865048 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.865281 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.865386 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.865581 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.865678 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.865882 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.865978 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.866180 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.866275 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.866477 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.866574 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.866782 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.866870 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.867081 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.867167 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.867380 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.867511 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.867678 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.867839 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.867976 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.868150 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.868274 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.868453 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.868602 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.868754 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.868931 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.869061 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.869262 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.869389 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.869582 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.869695 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.869888 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.869989 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.870253 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.870356 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.870511 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.870608 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.871342 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.871448 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.871664 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.871752 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.871977 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.872077 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.872274 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.872370 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.872576 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.872666 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.872876 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.872963 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.873271 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.873378 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.873578 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.873668 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.873882 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.873973 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.874183 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.874279 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.874483 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.874590 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.874784 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.874874 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.875111 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.875200 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.875414 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.875500 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.875736 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.875824 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.876051 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.876139 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.876356 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.876442 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.876665 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.876752 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.876968 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.877064 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.877315 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.877409 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.877622 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.877726 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.877930 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.878019 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.878235 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.878329 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.878540 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.878635 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.878847 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.878935 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.879154 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.879240 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.879461 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.879559 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.879767 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.879855 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.880080 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.880175 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.880383 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.880471 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.880708 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.880853 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.881025 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.881171 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.881465 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.881592 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.881782 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.881870 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.882108 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.882220 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.882425 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.882515 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.882743 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.882877 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.883051 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.883151 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.883355 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.883446 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.883599 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 13:46:56.883691 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.883965 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.884277 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.884594 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.884900 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.885232 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.885546 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.885871 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.886193 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.887084 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.887413 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.887740 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.888088 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.888407 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.888753 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.889074 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.889432 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.889742 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.890050 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:46:56.890296 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 13:46:56.943165 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO dbcounter [None req-3b38cdc0-bec5-4256-95fa-44d44afc7f52 None None] Registered counter for database nova_api May 26 13:46:56.950015 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO dbcounter [None req-c0190e2c-9852-4c9a-aae3-929dbf9b572b None None] Registered counter for database nova_api May 26 13:46:56.965210 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG oslo_db.sqlalchemy.engines [None req-3b38cdc0-bec5-4256-95fa-44d44afc7f52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103107) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:46:56.969439 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG oslo_db.sqlalchemy.engines [None req-c0190e2c-9852-4c9a-aae3-929dbf9b572b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103108) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:46:56.971934 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG dbcounter [-] [103107] Writer thread running {{(pid=103107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:46:56.976127 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG dbcounter [-] [103108] Writer thread running {{(pid=103108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:46:57.029168 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.context [None req-3b38cdc0-bec5-4256-95fa-44d44afc7f52 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1cef31d3-1884-4927-928a-7d3f347ed78a(cell1) {{(pid=103107) load_cells /opt/stack/nova/nova/context.py:464}} May 26 13:46:57.033392 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG oslo_concurrency.lockutils [None req-3b38cdc0-bec5-4256-95fa-44d44afc7f52 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:57.033526 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.context [None req-c0190e2c-9852-4c9a-aae3-929dbf9b572b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1cef31d3-1884-4927-928a-7d3f347ed78a(cell1) {{(pid=103108) load_cells /opt/stack/nova/nova/context.py:464}} May 26 13:46:57.034954 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG oslo_concurrency.lockutils [None req-3b38cdc0-bec5-4256-95fa-44d44afc7f52 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:57.035727 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG oslo_concurrency.lockutils [None req-3b38cdc0-bec5-4256-95fa-44d44afc7f52 None None] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:57.037534 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG oslo_concurrency.lockutils [None req-c0190e2c-9852-4c9a-aae3-929dbf9b572b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:57.037739 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG oslo_concurrency.lockutils [None req-3b38cdc0-bec5-4256-95fa-44d44afc7f52 None None] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:57.039087 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG oslo_concurrency.lockutils [None req-c0190e2c-9852-4c9a-aae3-929dbf9b572b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:57.039722 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO dbcounter [None req-3b38cdc0-bec5-4256-95fa-44d44afc7f52 None None] Registered counter for database nova_cell0 May 26 13:46:57.039877 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG oslo_concurrency.lockutils [None req-c0190e2c-9852-4c9a-aae3-929dbf9b572b None None] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:57.042091 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG oslo_concurrency.lockutils [None req-c0190e2c-9852-4c9a-aae3-929dbf9b572b None None] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:57.044561 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO dbcounter [None req-3b38cdc0-bec5-4256-95fa-44d44afc7f52 None None] Registered counter for database nova_cell1 May 26 13:46:57.044669 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO dbcounter [None req-c0190e2c-9852-4c9a-aae3-929dbf9b572b None None] Registered counter for database nova_cell0 May 26 13:46:57.048511 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO dbcounter [None req-c0190e2c-9852-4c9a-aae3-929dbf9b572b None None] Registered counter for database nova_cell1 May 26 13:46:57.055108 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG oslo_db.sqlalchemy.engines [None req-3b38cdc0-bec5-4256-95fa-44d44afc7f52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103107) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:46:57.056204 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG oslo_db.sqlalchemy.engines [None req-c0190e2c-9852-4c9a-aae3-929dbf9b572b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103108) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:46:57.056341 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG oslo_db.sqlalchemy.engines [None req-3b38cdc0-bec5-4256-95fa-44d44afc7f52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103107) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:46:57.058088 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG oslo_db.sqlalchemy.engines [None req-c0190e2c-9852-4c9a-aae3-929dbf9b572b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103108) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:46:57.063685 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG dbcounter [-] [103107] Writer thread running {{(pid=103107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:46:57.064641 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG dbcounter [-] [103108] Writer thread running {{(pid=103108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:46:57.064974 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG dbcounter [-] [103107] Writer thread running {{(pid=103107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:46:57.066661 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG dbcounter [-] [103108] Writer thread running {{(pid=103108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:46:57.210869 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO dbcounter [None req-c0190e2c-9852-4c9a-aae3-929dbf9b572b None None] Registered counter for database nova_cell0 May 26 13:46:57.212260 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO dbcounter [None req-3b38cdc0-bec5-4256-95fa-44d44afc7f52 None None] Registered counter for database nova_cell0 May 26 13:46:57.221264 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG oslo_db.sqlalchemy.engines [None req-c0190e2c-9852-4c9a-aae3-929dbf9b572b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103108) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:46:57.222933 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG oslo_db.sqlalchemy.engines [None req-3b38cdc0-bec5-4256-95fa-44d44afc7f52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103107) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:46:57.225731 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG dbcounter [-] [103108] Writer thread running {{(pid=103108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:46:57.227517 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG dbcounter [-] [103107] Writer thread running {{(pid=103107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:46:57.560814 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: WARNING keystonemiddleware.auth_token [None req-c0190e2c-9852-4c9a-aae3-929dbf9b572b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 13:46:57.564794 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: WARNING keystonemiddleware.auth_token [None req-3b38cdc0-bec5-4256-95fa-44d44afc7f52 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 13:46:57.568112 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: WARNING keystonemiddleware.auth_token [None req-c0190e2c-9852-4c9a-aae3-929dbf9b572b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 13:46:57.571994 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: WARNING keystonemiddleware.auth_token [None req-3b38cdc0-bec5-4256-95fa-44d44afc7f52 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 13:46:57.913494 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: WARNING keystonemiddleware.auth_token [None req-3b38cdc0-bec5-4256-95fa-44d44afc7f52 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 13:46:57.914542 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: WARNING keystonemiddleware.auth_token [None req-c0190e2c-9852-4c9a-aae3-929dbf9b572b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 13:46:57.920128 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: WARNING keystonemiddleware.auth_token [None req-3b38cdc0-bec5-4256-95fa-44d44afc7f52 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 13:46:57.921205 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: WARNING keystonemiddleware.auth_token [None req-c0190e2c-9852-4c9a-aae3-929dbf9b572b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 13:46:57.925457 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557d2adc49c0 pid: 103107 (default app) May 26 13:46:57.926484 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557d2adc49c0 pid: 103108 (default app) May 26 13:46:57.927528 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-3b38cdc0-bec5-4256-95fa-44d44afc7f52 None None] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:57.928781 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-3b38cdc0-bec5-4256-95fa-44d44afc7f52 None None] 10.222.0.91 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001763 May 26 13:46:57.929213 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 1/1] 10.222.0.91 () {50 vars in 788 bytes} [Thu May 26 13:46:57 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:48:18.844282 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-c0190e2c-9852-4c9a-aae3-929dbf9b572b None None] Calling method '>' {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:18.845806 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-c0190e2c-9852-4c9a-aae3-929dbf9b572b None None] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002728 May 26 13:48:18.846236 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 1/2] 10.222.0.91 () {54 vars in 930 bytes} [Thu May 26 13:48:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:48:18.862424 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG dbcounter [-] [103107] Writing DB stats nova_api:SELECT=3 {{(pid=103107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:48:18.863348 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG dbcounter [-] [103107] Writing DB stats nova_cell1:SELECT=3 {{(pid=103107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:48:18.864185 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG dbcounter [-] [103107] Writing DB stats nova_cell0:SELECT=3 {{(pid=103107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:48:18.865194 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG dbcounter [-] [103107] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:48:19.371041 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-3e296f96-a622-4b6b-8e65-2e0425ee4f01 admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:19.405704 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-3e296f96-a622-4b6b-8e65-2e0425ee4f01 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.552666 May 26 13:48:19.406467 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 2/3] 10.222.0.91 () {60 vars in 1291 bytes} [Thu May 26 13:48:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:48:21.844057 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-c0190e2c-9852-4c9a-aae3-929dbf9b572b None None] Calling method '>' {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:21.846102 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-c0190e2c-9852-4c9a-aae3-929dbf9b572b None None] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002656 May 26 13:48:21.848956 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 2/4] 10.222.0.91 () {54 vars in 930 bytes} [Thu May 26 13:48:21 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:48:21.924396 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-f38ed7ef-da19-4d8b-b42e-484bbc54a019 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "ram": 256, "disk": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:21.944076 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 13:48:21.944076 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: warnings.warn(msg) May 26 13:48:21.975691 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-f38ed7ef-da19-4d8b-b42e-484bbc54a019 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.122095 May 26 13:48:21.976416 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 3/5] 10.222.0.91 () {64 vars in 1282 bytes} [Thu May 26 13:48:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 13:48:21.991008 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG dbcounter [-] [103108] Writing DB stats nova_api:SELECT=3 {{(pid=103108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:48:21.992107 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG dbcounter [-] [103108] Writing DB stats nova_cell0:SELECT=3 {{(pid=103108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:48:21.993517 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG dbcounter [-] [103108] Writing DB stats nova_cell1:SELECT=3 {{(pid=103108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:48:21.994647 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG dbcounter [-] [103108] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:48:22.204770 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-d64ce0ee-1f76-46b6-8021-f56fd6ccbff5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:22.207555 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 13:48:22.207555 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: warnings.warn(msg) May 26 13:48:22.274512 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-d64ce0ee-1f76-46b6-8021-f56fd6ccbff5 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288817 May 26 13:48:22.286260 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 3/6] 10.222.0.91 () {64 vars in 1335 bytes} [Thu May 26 13:48:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:24.621217 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-f38ed7ef-da19-4d8b-b42e-484bbc54a019 admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:24.622233 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-f38ed7ef-da19-4d8b-b42e-484bbc54a019 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 May 26 13:48:24.622634 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 4/7] 10.222.0.91 () {54 vars in 930 bytes} [Thu May 26 13:48:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:48:24.738978 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-b181e00e-3bd7-4ecc-a309-e0ff9d611b5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "d1"}} {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:24.757675 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 13:48:24.757675 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: warnings.warn(msg) May 26 13:48:24.782763 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-b181e00e-3bd7-4ecc-a309-e0ff9d611b5f admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.152725 May 26 13:48:24.782763 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 4/8] 10.222.0.91 () {64 vars in 1282 bytes} [Thu May 26 13:48:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:48:24.795143 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-22feaf34-2cf3-4427-b35c-8bbedaca1703 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:24.796650 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 13:48:24.796650 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: warnings.warn(msg) May 26 13:48:24.829189 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-22feaf34-2cf3-4427-b35c-8bbedaca1703 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037663 May 26 13:48:24.832903 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 5/9] 10.222.0.91 () {64 vars in 1335 bytes} [Thu May 26 13:48:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:48:27.171903 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-b181e00e-3bd7-4ecc-a309-e0ff9d611b5f admin admin] Calling method '>' {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:27.172949 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-b181e00e-3bd7-4ecc-a309-e0ff9d611b5f admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 May 26 13:48:27.173461 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 5/10] 10.222.0.91 () {54 vars in 930 bytes} [Thu May 26 13:48:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:48:27.281848 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-d0aa0c07-ae65-46e1-a6cf-4949cc3c7052 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 1024, "name": "ds1G", "id": "d2"}} {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:27.311990 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-d0aa0c07-ae65-46e1-a6cf-4949cc3c7052 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.131214 May 26 13:48:27.314071 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 6/11] 10.222.0.91 () {64 vars in 1282 bytes} [Thu May 26 13:48:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:48:27.326149 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-a8eea1c8-7070-4d29-ae77-41e015d7fe13 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:27.359633 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-a8eea1c8-7070-4d29-ae77-41e015d7fe13 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037286 May 26 13:48:27.360234 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 6/12] 10.222.0.91 () {64 vars in 1335 bytes} [Thu May 26 13:48:27 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:48:29.735447 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-d0aa0c07-ae65-46e1-a6cf-4949cc3c7052 admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:29.736462 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-d0aa0c07-ae65-46e1-a6cf-4949cc3c7052 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 26 13:48:29.737032 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 7/13] 10.222.0.91 () {54 vars in 930 bytes} [Thu May 26 13:48:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:48:29.802392 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-1bee0fb3-3bec-4ee7-8fc5-d59a7f44a793 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "ram": 2048, "id": "d3", "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:29.823221 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-1bee0fb3-3bec-4ee7-8fc5-d59a7f44a793 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079688 May 26 13:48:29.823893 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 7/14] 10.222.0.91 () {64 vars in 1282 bytes} [Thu May 26 13:48:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:48:29.836661 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-37691737-1226-4c1e-88ad-016be56958aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:29.866227 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-37691737-1226-4c1e-88ad-016be56958aa admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033580 May 26 13:48:29.867147 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 8/15] 10.222.0.91 () {64 vars in 1335 bytes} [Thu May 26 13:48:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:32.152829 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-1bee0fb3-3bec-4ee7-8fc5-d59a7f44a793 admin admin] Calling method '>' {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:32.154001 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-1bee0fb3-3bec-4ee7-8fc5-d59a7f44a793 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001622 May 26 13:48:32.154489 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 8/16] 10.222.0.91 () {54 vars in 930 bytes} [Thu May 26 13:48:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:48:32.220507 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-d3334308-d27e-4ac2-af4d-0e187bfe7e99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "ram": 4096, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "id": "d4", "rxtx_factor": 1.0}} {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:32.238721 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-d3334308-d27e-4ac2-af4d-0e187bfe7e99 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077954 May 26 13:48:32.239927 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 9/17] 10.222.0.91 () {64 vars in 1282 bytes} [Thu May 26 13:48:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 13:48:32.252755 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-3eecb4ca-cc2f-4015-b8f4-bcb544ff5e71 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:32.286135 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-3eecb4ca-cc2f-4015-b8f4-bcb544ff5e71 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036933 May 26 13:48:32.286729 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 9/18] 10.222.0.91 () {64 vars in 1335 bytes} [Thu May 26 13:48:32 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:34.651107 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-d3334308-d27e-4ac2-af4d-0e187bfe7e99 admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:34.652124 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-d3334308-d27e-4ac2-af4d-0e187bfe7e99 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 26 13:48:34.652699 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 10/19] 10.222.0.91 () {54 vars in 930 bytes} [Thu May 26 13:48:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:48:34.714375 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-062e243e-d501-46d4-973a-c1d4e63686f9 admin admin] Calling method '>' {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:34.744482 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-062e243e-d501-46d4-973a-c1d4e63686f9 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.085342 May 26 13:48:34.745037 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 10/20] 10.222.0.91 () {60 vars in 1291 bytes} [Thu May 26 13:48:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:37.035986 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-d3334308-d27e-4ac2-af4d-0e187bfe7e99 admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:37.037032 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-d3334308-d27e-4ac2-af4d-0e187bfe7e99 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 26 13:48:37.037454 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 11/21] 10.222.0.91 () {54 vars in 930 bytes} [Thu May 26 13:48:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:48:37.110258 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-2f682d69-937c-4e2d-bda8-2a690218a174 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "ram": 512, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:37.128715 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-2f682d69-937c-4e2d-bda8-2a690218a174 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.085043 May 26 13:48:37.129295 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 11/22] 10.222.0.91 () {64 vars in 1282 bytes} [Thu May 26 13:48:37 2022] POST /compute/v2.1/flavors => generated 402 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:48:37.141756 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-32865ae0-5b97-404b-bf1a-47c4b8d6c599 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:37.170021 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-32865ae0-5b97-404b-bf1a-47c4b8d6c599 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031720 May 26 13:48:37.170798 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 12/23] 10.222.0.91 () {64 vars in 1332 bytes} [Thu May 26 13:48:37 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:39.436879 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-2f682d69-937c-4e2d-bda8-2a690218a174 admin admin] Calling method '>' {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:39.437977 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-2f682d69-937c-4e2d-bda8-2a690218a174 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 May 26 13:48:39.438379 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 12/24] 10.222.0.91 () {54 vars in 930 bytes} [Thu May 26 13:48:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:48:39.511469 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-7c816598-f46a-4f23-a3a8-cc0be792e425 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "id": "2", "vcpus": 1}} {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:39.540836 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-7c816598-f46a-4f23-a3a8-cc0be792e425 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.094457 May 26 13:48:39.541578 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 13/25] 10.222.0.91 () {64 vars in 1282 bytes} [Thu May 26 13:48:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:48:39.553716 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-a9668f6c-a216-4068-9610-393ce00e94a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:39.577893 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-a9668f6c-a216-4068-9610-393ce00e94a9 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027930 May 26 13:48:39.578514 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 13/26] 10.222.0.91 () {64 vars in 1332 bytes} [Thu May 26 13:48:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:41.815589 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-7c816598-f46a-4f23-a3a8-cc0be792e425 admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:41.816676 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-7c816598-f46a-4f23-a3a8-cc0be792e425 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 26 13:48:41.817011 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 14/27] 10.222.0.91 () {54 vars in 930 bytes} [Thu May 26 13:48:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:48:41.887898 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-3aa68317-0732-419e-b7b5-525b3f5b7a06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 2, "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "id": "3", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:41.906330 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-3aa68317-0732-419e-b7b5-525b3f5b7a06 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.083013 May 26 13:48:41.906885 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 14/28] 10.222.0.91 () {64 vars in 1282 bytes} [Thu May 26 13:48:41 2022] POST /compute/v2.1/flavors => generated 406 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:48:41.920731 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-99554285-0217-461b-9a8d-c960f6014d33 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:41.947774 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-99554285-0217-461b-9a8d-c960f6014d33 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032134 May 26 13:48:41.948368 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 15/29] 10.222.0.91 () {64 vars in 1332 bytes} [Thu May 26 13:48:41 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:44.187246 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-3aa68317-0732-419e-b7b5-525b3f5b7a06 admin admin] Calling method '>' {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:44.188253 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-3aa68317-0732-419e-b7b5-525b3f5b7a06 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 26 13:48:44.188814 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 15/30] 10.222.0.91 () {54 vars in 930 bytes} [Thu May 26 13:48:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:48:44.247973 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-f958e5b0-98ea-47de-979e-30bd1a41ae05 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 8192, "id": "4", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:44.265845 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-f958e5b0-98ea-47de-979e-30bd1a41ae05 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071167 May 26 13:48:44.266423 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 16/31] 10.222.0.91 () {64 vars in 1282 bytes} [Thu May 26 13:48:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:48:44.278222 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-57b24411-398d-4341-b58f-11dcd51269cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:44.301614 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-57b24411-398d-4341-b58f-11dcd51269cc admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026989 May 26 13:48:44.302193 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 16/32] 10.222.0.91 () {64 vars in 1332 bytes} [Thu May 26 13:48:44 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:48:46.643190 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-f958e5b0-98ea-47de-979e-30bd1a41ae05 admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:46.644906 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-f958e5b0-98ea-47de-979e-30bd1a41ae05 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002145 May 26 13:48:46.645407 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 17/33] 10.222.0.91 () {54 vars in 930 bytes} [Thu May 26 13:48:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:48:46.708342 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-dd56e001-b576-4a2f-a665-a23461c5f0dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.xlarge", "disk": 160, "vcpus": 8, "ram": 16384, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "5"}} {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:46.726869 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-dd56e001-b576-4a2f-a665-a23461c5f0dd admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.074527 May 26 13:48:46.727720 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 17/34] 10.222.0.91 () {64 vars in 1282 bytes} [Thu May 26 13:48:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:48:46.753775 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-3f58824c-d3f7-466b-b3f4-e76ddb0ab9b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:46.783651 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-3f58824c-d3f7-466b-b3f4-e76ddb0ab9b5 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043688 May 26 13:48:46.784350 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 18/35] 10.222.0.91 () {64 vars in 1332 bytes} [Thu May 26 13:48:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:49:12.657366 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-dd56e001-b576-4a2f-a665-a23461c5f0dd admin admin] Calling method '>' {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:12.660147 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-dd56e001-b576-4a2f-a665-a23461c5f0dd admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002486 May 26 13:49:12.660147 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 18/36] 10.222.0.91 () {54 vars in 930 bytes} [Thu May 26 13:49:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:49:12.671599 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG dbcounter [-] [103107] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:49:12.727179 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-78a84f61-64da-4f8d-95b4-24e328318f5e admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:12.745474 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-78a84f61-64da-4f8d-95b4-24e328318f5e admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.078363 May 26 13:49:12.746073 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 19/37] 10.222.0.91 () {60 vars in 1291 bytes} [Thu May 26 13:49:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:13.783758 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-dd56e001-b576-4a2f-a665-a23461c5f0dd admin admin] Calling method '>' {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:13.785085 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-dd56e001-b576-4a2f-a665-a23461c5f0dd admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002068 May 26 13:49:13.785589 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 19/38] 10.222.0.91 () {56 vars in 1074 bytes} [Thu May 26 13:49:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:49:14.029232 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-9cd8c099-4656-4cfd-b2eb-58cce818158f admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:14.037380 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.wsgi [None req-9cd8c099-4656-4cfd-b2eb-58cce818158f admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 13:49:14.040888 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-9cd8c099-4656-4cfd-b2eb-58cce818158f admin admin] Request method failure captured: May 26 13:49:14.040888 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 13:49:14.040888 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: Accept: application/json May 26 13:49:14.040888 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: Accept-Encoding: gzip, deflate May 26 13:49:14.040888 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: Connection: keep-alive May 26 13:49:14.040888 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: Content-Length: 0 May 26 13:49:14.040888 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: Host: 10.222.0.91 May 26 13:49:14.040888 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: Openstack-Api-Version: compute 2.90 May 26 13:49:14.040888 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: Openstack-System-Scope: None May 26 13:49:14.040888 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: User-Agent: python-novaclient May 26 13:49:14.040888 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Auth-Token: gAAAAABij4VZOnwD0cuNBjhvjYqmnJoQzn9DJgvtl8RctdzjBcGYA2bI5P0bdxO4a0mzv5mVlDWEvDMuVCiL_zwy-3bEB0aDWxB2cjABbI4C-sQ78qhQoNbrh9_1wWJRFRQyGGYacCgIMu5MeLGVZbACPKBpGLcUnlJZk81xEXaVmX6PS3QQLrM May 26 13:49:14.040888 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Domain-Id: None May 26 13:49:14.040888 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Domain-Name: None May 26 13:49:14.040888 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Identity-Status: Confirmed May 26 13:49:14.040888 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Is-Admin-Project: True May 26 13:49:14.040888 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Openstack-Nova-Api-Version: 2.90 May 26 13:49:14.040888 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Project-Domain-Id: default May 26 13:49:14.040888 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Project-Domain-Name: Default May 26 13:49:14.040888 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Project-Id: e741295126a84576b8368706b7ffe76d May 26 13:49:14.040888 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Project-Name: admin May 26 13:49:14.040888 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Role: member,admin,reader May 26 13:49:14.040888 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Roles: member,admin,reader May 26 13:49:14.043368 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/e741295126a84576b8368706b7ffe76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/e741295126a84576b8368706b7ffe76d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/e741295126a84576b8368706b7ffe76d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_e741295126a84576b8368706b7ffe76d", "adminURL": "http://10.222.0.91:8080"}]}] May 26 13:49:14.043368 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Tenant: admin May 26 13:49:14.043368 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Tenant-Id: e741295126a84576b8368706b7ffe76d May 26 13:49:14.043368 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Tenant-Name: admin May 26 13:49:14.043368 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-User: admin May 26 13:49:14.043368 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-User-Domain-Id: default May 26 13:49:14.043368 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-User-Domain-Name: Default May 26 13:49:14.043368 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-User-Id: 42b8c6ab6fbb49deaec22b8b6964d6a5 May 26 13:49:14.043368 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-User-Name: admin May 26 13:49:14.043368 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: method: > May 26 13:49:14.043368 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: exception: Flavor 42 could not be found. May 26 13:49:14.043368 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: action_args: {'id': '42'} May 26 13:49:14.043368 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:49:14.043368 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:49:14.044813 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 13:49:14.044813 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 13:49:14.044813 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 13:49:14.044813 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 13:49:14.044813 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 13:49:14.044813 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 13:49:14.044813 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 13:49:14.044813 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 13:49:14.044813 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 13:49:14.044813 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:49:14.044813 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 13:49:14.044813 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 13:49:14.044813 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 13:49:14.044813 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi May 26 13:49:14.044813 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:49:14.044813 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi May 26 13:49:14.044813 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:49:14.044813 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:49:14.044813 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:49:14.046416 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:49:14.046416 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:49:14.046416 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:49:14.046416 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:49:14.046416 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 13:49:14.046416 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 13:49:14.046416 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 13:49:14.046416 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi May 26 13:49:14.046416 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:49:14.046416 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi May 26 13:49:14.046416 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:49:14.046416 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:49:14.046416 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:49:14.046416 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:49:14.046416 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:49:14.046416 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 13:49:14.046416 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi May 26 13:49:14.046416 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-9cd8c099-4656-4cfd-b2eb-58cce818158f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:49:14.047720 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-9cd8c099-4656-4cfd-b2eb-58cce818158f admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.070156 May 26 13:49:14.047720 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 20/39] 10.222.0.91 () {60 vars in 1190 bytes} [Thu May 26 13:49:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 26 13:49:14.054983 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-53610539-b310-405f-b02d-ea86dcc07503 admin admin] Calling method '>' {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:14.058129 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG dbcounter [-] [103108] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:49:14.079227 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-53610539-b310-405f-b02d-ea86dcc07503 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029083 May 26 13:49:14.079828 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 20/40] 10.222.0.91 () {60 vars in 1210 bytes} [Thu May 26 13:49:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:49:14.090844 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-fb344f70-7508-40d9-803d-b49ba9ee9df9 admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:14.112423 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-fb344f70-7508-40d9-803d-b49ba9ee9df9 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025340 May 26 13:49:14.112997 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 21/41] 10.222.0.91 () {60 vars in 1210 bytes} [Thu May 26 13:49:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:14.124418 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-5ba6270c-536f-4088-8633-257b2685f0e3 admin admin] Calling method '>' {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:14.130625 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.wsgi [None req-5ba6270c-536f-4088-8633-257b2685f0e3 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 13:49:14.134401 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-5ba6270c-536f-4088-8633-257b2685f0e3 admin admin] Request method failure captured: May 26 13:49:14.134401 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 13:49:14.134401 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: Accept: application/json May 26 13:49:14.134401 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: Accept-Encoding: gzip, deflate May 26 13:49:14.134401 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: Connection: keep-alive May 26 13:49:14.134401 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: Content-Length: 0 May 26 13:49:14.134401 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: Host: 10.222.0.91 May 26 13:49:14.134401 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: Openstack-Api-Version: compute 2.90 May 26 13:49:14.134401 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: Openstack-System-Scope: None May 26 13:49:14.134401 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: User-Agent: python-novaclient May 26 13:49:14.134401 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Auth-Token: gAAAAABij4VZOnwD0cuNBjhvjYqmnJoQzn9DJgvtl8RctdzjBcGYA2bI5P0bdxO4a0mzv5mVlDWEvDMuVCiL_zwy-3bEB0aDWxB2cjABbI4C-sQ78qhQoNbrh9_1wWJRFRQyGGYacCgIMu5MeLGVZbACPKBpGLcUnlJZk81xEXaVmX6PS3QQLrM May 26 13:49:14.134401 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Domain-Id: None May 26 13:49:14.134401 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Domain-Name: None May 26 13:49:14.134401 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Identity-Status: Confirmed May 26 13:49:14.134401 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Is-Admin-Project: True May 26 13:49:14.134401 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Openstack-Nova-Api-Version: 2.90 May 26 13:49:14.134401 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Project-Domain-Id: default May 26 13:49:14.134401 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Project-Domain-Name: Default May 26 13:49:14.134401 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Project-Id: e741295126a84576b8368706b7ffe76d May 26 13:49:14.134401 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Project-Name: admin May 26 13:49:14.134401 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Role: member,admin,reader May 26 13:49:14.134401 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Roles: member,admin,reader May 26 13:49:14.137403 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/e741295126a84576b8368706b7ffe76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/e741295126a84576b8368706b7ffe76d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/e741295126a84576b8368706b7ffe76d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_e741295126a84576b8368706b7ffe76d", "adminURL": "http://10.222.0.91:8080"}]}] May 26 13:49:14.137403 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Tenant: admin May 26 13:49:14.137403 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Tenant-Id: e741295126a84576b8368706b7ffe76d May 26 13:49:14.137403 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Tenant-Name: admin May 26 13:49:14.137403 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-User: admin May 26 13:49:14.137403 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-User-Domain-Id: default May 26 13:49:14.137403 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-User-Domain-Name: Default May 26 13:49:14.137403 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-User-Id: 42b8c6ab6fbb49deaec22b8b6964d6a5 May 26 13:49:14.137403 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-User-Name: admin May 26 13:49:14.137403 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: method: > May 26 13:49:14.137403 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: exception: Flavor 42 could not be found. May 26 13:49:14.137403 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: action_args: {'id': '42'} May 26 13:49:14.137403 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:49:14.137403 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:49:14.140794 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 13:49:14.140794 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 13:49:14.140794 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 13:49:14.140794 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 13:49:14.140794 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 13:49:14.140794 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 13:49:14.140794 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 13:49:14.140794 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 13:49:14.140794 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 13:49:14.140794 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:49:14.140794 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 13:49:14.140794 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 13:49:14.140794 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 13:49:14.140794 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi May 26 13:49:14.140794 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:49:14.140794 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi May 26 13:49:14.140794 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:49:14.140794 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:49:14.140794 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:49:14.142831 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:49:14.142831 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:49:14.142831 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:49:14.142831 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:49:14.142831 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 13:49:14.142831 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 13:49:14.142831 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 13:49:14.142831 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi May 26 13:49:14.142831 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:49:14.142831 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi May 26 13:49:14.142831 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:49:14.142831 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:49:14.142831 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:49:14.142831 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:49:14.142831 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:49:14.142831 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 13:49:14.142831 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi May 26 13:49:14.142831 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-5ba6270c-536f-4088-8633-257b2685f0e3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:49:14.144870 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-5ba6270c-536f-4088-8633-257b2685f0e3 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016541 May 26 13:49:14.144870 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 21/42] 10.222.0.91 () {60 vars in 1190 bytes} [Thu May 26 13:49:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 13:49:15.013683 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-fb344f70-7508-40d9-803d-b49ba9ee9df9 admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:15.014685 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-fb344f70-7508-40d9-803d-b49ba9ee9df9 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 May 26 13:49:15.015083 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 22/43] 10.222.0.91 () {56 vars in 1074 bytes} [Thu May 26 13:49:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:49:15.212638 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-50a9c536-4428-4bf0-a63b-62afc7a50862 admin admin] Calling method '>' {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:15.218158 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.wsgi [None req-50a9c536-4428-4bf0-a63b-62afc7a50862 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 13:49:15.219639 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-50a9c536-4428-4bf0-a63b-62afc7a50862 admin admin] Request method failure captured: May 26 13:49:15.219639 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 13:49:15.219639 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: Accept: application/json May 26 13:49:15.219639 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: Accept-Encoding: gzip, deflate May 26 13:49:15.219639 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: Connection: keep-alive May 26 13:49:15.219639 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: Content-Length: 0 May 26 13:49:15.219639 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: Host: 10.222.0.91 May 26 13:49:15.219639 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: Openstack-Api-Version: compute 2.90 May 26 13:49:15.219639 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: Openstack-System-Scope: None May 26 13:49:15.219639 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: User-Agent: python-novaclient May 26 13:49:15.219639 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Auth-Token: gAAAAABij4Va6GRyBYXrCYR_skwiWaWOJ2jWlHAkiq99iQEdlkeynt3XMMgeJa4ygf5UNTsEeKhgI7S1EWv252EQa3m5rbIlixPfg_UbBlwVb2TIhiwmjbhkbpUbbd7tcdi_RU6lW4Le70CBmwpvdOUT0UXA9S1GzA1QNdGc6Skl6k7HqhixpWY May 26 13:49:15.219639 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Domain-Id: None May 26 13:49:15.219639 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Domain-Name: None May 26 13:49:15.219639 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Identity-Status: Confirmed May 26 13:49:15.219639 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Is-Admin-Project: True May 26 13:49:15.219639 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Openstack-Nova-Api-Version: 2.90 May 26 13:49:15.219639 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Project-Domain-Id: default May 26 13:49:15.219639 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Project-Domain-Name: Default May 26 13:49:15.219639 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Project-Id: e741295126a84576b8368706b7ffe76d May 26 13:49:15.219639 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Project-Name: admin May 26 13:49:15.219639 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Role: member,admin,reader May 26 13:49:15.219639 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Roles: member,admin,reader May 26 13:49:15.222559 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/e741295126a84576b8368706b7ffe76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/e741295126a84576b8368706b7ffe76d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/e741295126a84576b8368706b7ffe76d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_e741295126a84576b8368706b7ffe76d", "adminURL": "http://10.222.0.91:8080"}]}] May 26 13:49:15.222559 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Tenant: admin May 26 13:49:15.222559 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Tenant-Id: e741295126a84576b8368706b7ffe76d May 26 13:49:15.222559 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Tenant-Name: admin May 26 13:49:15.222559 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-User: admin May 26 13:49:15.222559 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-User-Domain-Id: default May 26 13:49:15.222559 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-User-Domain-Name: Default May 26 13:49:15.222559 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-User-Id: 42b8c6ab6fbb49deaec22b8b6964d6a5 May 26 13:49:15.222559 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-User-Name: admin May 26 13:49:15.222559 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: method: > May 26 13:49:15.222559 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: exception: Flavor 84 could not be found. May 26 13:49:15.222559 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: action_args: {'id': '84'} May 26 13:49:15.222559 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:49:15.222559 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:49:15.224258 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 13:49:15.224258 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 13:49:15.224258 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 13:49:15.224258 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 13:49:15.224258 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 13:49:15.224258 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 13:49:15.224258 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 13:49:15.224258 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 13:49:15.224258 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 13:49:15.224258 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:49:15.224258 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 13:49:15.224258 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 13:49:15.224258 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 13:49:15.224258 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi May 26 13:49:15.224258 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:49:15.224258 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi May 26 13:49:15.224258 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:49:15.224258 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:49:15.224258 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:49:15.225758 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:49:15.225758 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:49:15.225758 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:49:15.225758 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:49:15.225758 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 13:49:15.225758 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 13:49:15.225758 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 13:49:15.225758 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi May 26 13:49:15.225758 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:49:15.225758 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi May 26 13:49:15.225758 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:49:15.225758 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:49:15.225758 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:49:15.225758 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:49:15.225758 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:49:15.225758 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 13:49:15.225758 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi May 26 13:49:15.225758 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-50a9c536-4428-4bf0-a63b-62afc7a50862 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:49:15.228002 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-50a9c536-4428-4bf0-a63b-62afc7a50862 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.066458 May 26 13:49:15.228002 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 22/44] 10.222.0.91 () {60 vars in 1190 bytes} [Thu May 26 13:49:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 26 13:49:15.231091 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-8ce3a95e-25ef-4ba5-8c26-2b586a5869dd admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:15.246761 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-8ce3a95e-25ef-4ba5-8c26-2b586a5869dd admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019186 May 26 13:49:15.247306 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 23/45] 10.222.0.91 () {60 vars in 1210 bytes} [Thu May 26 13:49:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:49:15.258832 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-3ab3462a-901a-4b44-af10-62ad8fa4a3fb admin admin] Calling method '>' {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:15.273196 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-3ab3462a-901a-4b44-af10-62ad8fa4a3fb admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019286 May 26 13:49:15.273818 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 23/46] 10.222.0.91 () {60 vars in 1210 bytes} [Thu May 26 13:49:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:15.284634 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-a99734a9-6131-4f86-9ef6-824fb29812de admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:15.290827 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.wsgi [None req-a99734a9-6131-4f86-9ef6-824fb29812de admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 13:49:15.292348 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-a99734a9-6131-4f86-9ef6-824fb29812de admin admin] Request method failure captured: May 26 13:49:15.292348 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 13:49:15.292348 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: Accept: application/json May 26 13:49:15.292348 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: Accept-Encoding: gzip, deflate May 26 13:49:15.292348 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: Connection: keep-alive May 26 13:49:15.292348 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: Content-Length: 0 May 26 13:49:15.292348 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: Host: 10.222.0.91 May 26 13:49:15.292348 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: Openstack-Api-Version: compute 2.90 May 26 13:49:15.292348 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: Openstack-System-Scope: None May 26 13:49:15.292348 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: User-Agent: python-novaclient May 26 13:49:15.292348 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Auth-Token: gAAAAABij4Va6GRyBYXrCYR_skwiWaWOJ2jWlHAkiq99iQEdlkeynt3XMMgeJa4ygf5UNTsEeKhgI7S1EWv252EQa3m5rbIlixPfg_UbBlwVb2TIhiwmjbhkbpUbbd7tcdi_RU6lW4Le70CBmwpvdOUT0UXA9S1GzA1QNdGc6Skl6k7HqhixpWY May 26 13:49:15.292348 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Domain-Id: None May 26 13:49:15.292348 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Domain-Name: None May 26 13:49:15.292348 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Identity-Status: Confirmed May 26 13:49:15.292348 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Is-Admin-Project: True May 26 13:49:15.292348 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Openstack-Nova-Api-Version: 2.90 May 26 13:49:15.292348 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Project-Domain-Id: default May 26 13:49:15.292348 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Project-Domain-Name: Default May 26 13:49:15.292348 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Project-Id: e741295126a84576b8368706b7ffe76d May 26 13:49:15.292348 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Project-Name: admin May 26 13:49:15.292348 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Role: member,admin,reader May 26 13:49:15.292348 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Roles: member,admin,reader May 26 13:49:15.294461 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/e741295126a84576b8368706b7ffe76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/e741295126a84576b8368706b7ffe76d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/e741295126a84576b8368706b7ffe76d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_e741295126a84576b8368706b7ffe76d", "adminURL": "http://10.222.0.91:8080"}]}] May 26 13:49:15.294461 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Tenant: admin May 26 13:49:15.294461 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Tenant-Id: e741295126a84576b8368706b7ffe76d May 26 13:49:15.294461 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Tenant-Name: admin May 26 13:49:15.294461 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-User: admin May 26 13:49:15.294461 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-User-Domain-Id: default May 26 13:49:15.294461 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-User-Domain-Name: Default May 26 13:49:15.294461 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-User-Id: 42b8c6ab6fbb49deaec22b8b6964d6a5 May 26 13:49:15.294461 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-User-Name: admin May 26 13:49:15.294461 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: method: > May 26 13:49:15.294461 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: exception: Flavor 84 could not be found. May 26 13:49:15.294461 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: action_args: {'id': '84'} May 26 13:49:15.294461 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:49:15.294461 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:49:15.295611 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 13:49:15.295611 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 13:49:15.295611 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 13:49:15.295611 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 13:49:15.295611 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 13:49:15.295611 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 13:49:15.295611 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 13:49:15.295611 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 13:49:15.295611 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 13:49:15.295611 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:49:15.295611 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 13:49:15.295611 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 13:49:15.295611 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 13:49:15.295611 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi May 26 13:49:15.295611 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:49:15.295611 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi May 26 13:49:15.295611 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:49:15.295611 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:49:15.295611 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:49:15.296894 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:49:15.296894 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:49:15.296894 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:49:15.296894 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:49:15.296894 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 13:49:15.296894 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 13:49:15.296894 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 13:49:15.296894 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi May 26 13:49:15.296894 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:49:15.296894 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi May 26 13:49:15.296894 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:49:15.296894 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:49:15.296894 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:49:15.296894 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:49:15.296894 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:49:15.296894 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 13:49:15.296894 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi May 26 13:49:15.296894 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-a99734a9-6131-4f86-9ef6-824fb29812de admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:49:15.298438 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-a99734a9-6131-4f86-9ef6-824fb29812de admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012732 May 26 13:49:15.298438 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 24/47] 10.222.0.91 () {60 vars in 1190 bytes} [Thu May 26 13:49:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 13:49:16.207917 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-3ab3462a-901a-4b44-af10-62ad8fa4a3fb admin admin] Calling method '>' {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:16.209731 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-3ab3462a-901a-4b44-af10-62ad8fa4a3fb admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002468 May 26 13:49:16.210497 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 24/48] 10.222.0.91 () {56 vars in 1074 bytes} [Thu May 26 13:49:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:49:16.416301 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-f2a2b75a-1c13-4f47-b3fd-32655344ca21 admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:16.422257 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.wsgi [None req-f2a2b75a-1c13-4f47-b3fd-32655344ca21 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 13:49:16.423774 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-f2a2b75a-1c13-4f47-b3fd-32655344ca21 admin admin] Request method failure captured: May 26 13:49:16.423774 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 13:49:16.423774 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: Accept: application/json May 26 13:49:16.423774 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: Accept-Encoding: gzip, deflate May 26 13:49:16.423774 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: Connection: keep-alive May 26 13:49:16.423774 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: Content-Length: 0 May 26 13:49:16.423774 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: Host: 10.222.0.91 May 26 13:49:16.423774 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: Openstack-Api-Version: compute 2.90 May 26 13:49:16.423774 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: Openstack-System-Scope: None May 26 13:49:16.423774 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: User-Agent: python-novaclient May 26 13:49:16.423774 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Auth-Token: gAAAAABij4VcR_bsCFPGlU1TPqMRAcHXaZQh2KdNAstZkN-ZUFai4Zp5A1xHHkdwJso9sCvJXtt2ZNL_cV16l6vdpc4RS7Mrma7H-rdtAheWq_sJmmRA1B2ReIzbcJ58nCbrgnJ0TRO8NwQSiTeSjMQlmiJQAsD_NljKU_G1aPtOvcwhgH0j1Bs May 26 13:49:16.423774 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Domain-Id: None May 26 13:49:16.423774 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Domain-Name: None May 26 13:49:16.423774 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Identity-Status: Confirmed May 26 13:49:16.423774 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Is-Admin-Project: True May 26 13:49:16.423774 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Openstack-Nova-Api-Version: 2.90 May 26 13:49:16.423774 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Project-Domain-Id: default May 26 13:49:16.423774 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Project-Domain-Name: Default May 26 13:49:16.423774 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Project-Id: e741295126a84576b8368706b7ffe76d May 26 13:49:16.423774 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Project-Name: admin May 26 13:49:16.423774 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Role: member,admin,reader May 26 13:49:16.423774 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Roles: member,admin,reader May 26 13:49:16.426150 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/e741295126a84576b8368706b7ffe76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/e741295126a84576b8368706b7ffe76d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/e741295126a84576b8368706b7ffe76d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_e741295126a84576b8368706b7ffe76d", "adminURL": "http://10.222.0.91:8080"}]}] May 26 13:49:16.426150 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Tenant: admin May 26 13:49:16.426150 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Tenant-Id: e741295126a84576b8368706b7ffe76d May 26 13:49:16.426150 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-Tenant-Name: admin May 26 13:49:16.426150 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-User: admin May 26 13:49:16.426150 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-User-Domain-Id: default May 26 13:49:16.426150 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-User-Domain-Name: Default May 26 13:49:16.426150 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-User-Id: 42b8c6ab6fbb49deaec22b8b6964d6a5 May 26 13:49:16.426150 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: X-User-Name: admin May 26 13:49:16.426150 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: method: > May 26 13:49:16.426150 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: exception: Flavor 451 could not be found. May 26 13:49:16.426150 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: action_args: {'id': '451'} May 26 13:49:16.426150 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:49:16.426150 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:49:16.427781 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 13:49:16.427781 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 13:49:16.427781 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 13:49:16.427781 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 13:49:16.427781 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 13:49:16.427781 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 13:49:16.427781 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 13:49:16.427781 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 13:49:16.427781 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 13:49:16.427781 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:49:16.427781 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 13:49:16.427781 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 13:49:16.427781 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 13:49:16.427781 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi May 26 13:49:16.427781 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:49:16.427781 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi May 26 13:49:16.427781 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:49:16.427781 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:49:16.427781 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:49:16.429901 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:49:16.429901 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:49:16.429901 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:49:16.429901 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:49:16.429901 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 13:49:16.429901 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 13:49:16.429901 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 13:49:16.429901 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi May 26 13:49:16.429901 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:49:16.429901 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi May 26 13:49:16.429901 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:49:16.429901 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:49:16.429901 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:49:16.429901 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:49:16.429901 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:49:16.429901 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 13:49:16.429901 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: ERROR nova.api.openstack.wsgi May 26 13:49:16.429901 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-f2a2b75a-1c13-4f47-b3fd-32655344ca21 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:49:16.431744 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-f2a2b75a-1c13-4f47-b3fd-32655344ca21 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.075600 May 26 13:49:16.431744 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 25/49] 10.222.0.91 () {60 vars in 1193 bytes} [Thu May 26 13:49:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 13:49:16.438369 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-04891420-ae08-4f92-947c-9d8a6731a352 admin admin] Calling method '>' {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:16.454918 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-04891420-ae08-4f92-947c-9d8a6731a352 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020335 May 26 13:49:16.455489 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 25/50] 10.222.0.91 () {60 vars in 1210 bytes} [Thu May 26 13:49:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:49:16.467722 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-3527e394-c55b-4422-9127-0e956cdbf1b7 admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:16.482204 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-3527e394-c55b-4422-9127-0e956cdbf1b7 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019456 May 26 13:49:16.482763 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 26/51] 10.222.0.91 () {60 vars in 1210 bytes} [Thu May 26 13:49:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:16.492455 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-3f8a9ce1-4ab9-4d13-8cae-35ebce0d1857 admin admin] Calling method '>' {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:16.498028 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.wsgi [None req-3f8a9ce1-4ab9-4d13-8cae-35ebce0d1857 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 13:49:16.499731 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-3f8a9ce1-4ab9-4d13-8cae-35ebce0d1857 admin admin] Request method failure captured: May 26 13:49:16.499731 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 13:49:16.499731 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: Accept: application/json May 26 13:49:16.499731 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: Accept-Encoding: gzip, deflate May 26 13:49:16.499731 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: Connection: keep-alive May 26 13:49:16.499731 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: Content-Length: 0 May 26 13:49:16.499731 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: Host: 10.222.0.91 May 26 13:49:16.499731 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: Openstack-Api-Version: compute 2.90 May 26 13:49:16.499731 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: Openstack-System-Scope: None May 26 13:49:16.499731 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: User-Agent: python-novaclient May 26 13:49:16.499731 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Auth-Token: gAAAAABij4VcR_bsCFPGlU1TPqMRAcHXaZQh2KdNAstZkN-ZUFai4Zp5A1xHHkdwJso9sCvJXtt2ZNL_cV16l6vdpc4RS7Mrma7H-rdtAheWq_sJmmRA1B2ReIzbcJ58nCbrgnJ0TRO8NwQSiTeSjMQlmiJQAsD_NljKU_G1aPtOvcwhgH0j1Bs May 26 13:49:16.499731 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Domain-Id: None May 26 13:49:16.499731 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Domain-Name: None May 26 13:49:16.499731 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Identity-Status: Confirmed May 26 13:49:16.499731 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Is-Admin-Project: True May 26 13:49:16.499731 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Openstack-Nova-Api-Version: 2.90 May 26 13:49:16.499731 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Project-Domain-Id: default May 26 13:49:16.499731 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Project-Domain-Name: Default May 26 13:49:16.499731 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Project-Id: e741295126a84576b8368706b7ffe76d May 26 13:49:16.499731 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Project-Name: admin May 26 13:49:16.499731 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Role: member,admin,reader May 26 13:49:16.499731 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Roles: member,admin,reader May 26 13:49:16.502230 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/e741295126a84576b8368706b7ffe76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/e741295126a84576b8368706b7ffe76d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/e741295126a84576b8368706b7ffe76d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_e741295126a84576b8368706b7ffe76d", "adminURL": "http://10.222.0.91:8080"}]}] May 26 13:49:16.502230 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Tenant: admin May 26 13:49:16.502230 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Tenant-Id: e741295126a84576b8368706b7ffe76d May 26 13:49:16.502230 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-Tenant-Name: admin May 26 13:49:16.502230 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-User: admin May 26 13:49:16.502230 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-User-Domain-Id: default May 26 13:49:16.502230 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-User-Domain-Name: Default May 26 13:49:16.502230 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-User-Id: 42b8c6ab6fbb49deaec22b8b6964d6a5 May 26 13:49:16.502230 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: X-User-Name: admin May 26 13:49:16.502230 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: method: > May 26 13:49:16.502230 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: exception: Flavor 451 could not be found. May 26 13:49:16.502230 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: action_args: {'id': '451'} May 26 13:49:16.502230 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:49:16.502230 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:49:16.504172 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 13:49:16.504172 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 13:49:16.504172 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 13:49:16.504172 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 13:49:16.504172 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 13:49:16.504172 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 13:49:16.504172 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 13:49:16.504172 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 13:49:16.504172 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 13:49:16.504172 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:49:16.504172 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 13:49:16.504172 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 13:49:16.504172 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 13:49:16.504172 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi May 26 13:49:16.504172 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:49:16.504172 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi May 26 13:49:16.504172 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:49:16.504172 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:49:16.504172 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:49:16.506933 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:49:16.506933 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:49:16.506933 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:49:16.506933 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:49:16.506933 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 13:49:16.506933 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 13:49:16.506933 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 13:49:16.506933 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi May 26 13:49:16.506933 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:49:16.506933 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi May 26 13:49:16.506933 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:49:16.506933 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:49:16.506933 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:49:16.506933 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:49:16.506933 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:49:16.506933 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 13:49:16.506933 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: ERROR nova.api.openstack.wsgi May 26 13:49:16.506933 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-3f8a9ce1-4ab9-4d13-8cae-35ebce0d1857 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:49:16.509246 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-3f8a9ce1-4ab9-4d13-8cae-35ebce0d1857 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012385 May 26 13:49:16.509246 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 26/52] 10.222.0.91 () {60 vars in 1193 bytes} [Thu May 26 13:49:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 13:49:17.437274 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-3527e394-c55b-4422-9127-0e956cdbf1b7 admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:17.438316 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-3527e394-c55b-4422-9127-0e956cdbf1b7 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 May 26 13:49:17.438704 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 27/53] 10.222.0.91 () {56 vars in 1074 bytes} [Thu May 26 13:49:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:49:17.634648 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-97c54f36-bdcb-4a44-8c36-d7fe502c2ee9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:49:17.661242 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-97c54f36-bdcb-4a44-8c36-d7fe502c2ee9 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.084566 May 26 13:49:17.662360 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 27/54] 10.222.0.91 () {64 vars in 1235 bytes} [Thu May 26 13:49:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:49:18.534549 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-3527e394-c55b-4422-9127-0e956cdbf1b7 admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:18.535873 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-3527e394-c55b-4422-9127-0e956cdbf1b7 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001775 May 26 13:49:18.536427 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 28/55] 10.222.0.91 () {56 vars in 1074 bytes} [Thu May 26 13:49:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:49:18.728262 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-e72abe59-2396-48de-9387-e66ef4157123 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:49:18.746681 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-e72abe59-2396-48de-9387-e66ef4157123 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.075011 May 26 13:49:18.747926 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 28/56] 10.222.0.91 () {64 vars in 1235 bytes} [Thu May 26 13:49:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:49:19.645292 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-3527e394-c55b-4422-9127-0e956cdbf1b7 admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:19.646321 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-3527e394-c55b-4422-9127-0e956cdbf1b7 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 26 13:49:19.647215 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 29/57] 10.222.0.91 () {56 vars in 1074 bytes} [Thu May 26 13:49:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:49:19.852039 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-262b3f67-914e-4eb9-946e-82c20ba6c737 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:49:19.870887 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-262b3f67-914e-4eb9-946e-82c20ba6c737 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.079135 May 26 13:49:19.871680 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 29/58] 10.222.0.91 () {64 vars in 1235 bytes} [Thu May 26 13:49:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 13:49:20.775808 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-3527e394-c55b-4422-9127-0e956cdbf1b7 admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:20.776834 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-3527e394-c55b-4422-9127-0e956cdbf1b7 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 May 26 13:49:20.777296 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 30/59] 10.222.0.91 () {56 vars in 1074 bytes} [Thu May 26 13:49:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:49:20.973335 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-20ecb5ce-f275-4752-a56d-2bcf700ae556 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:49:20.993738 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-20ecb5ce-f275-4752-a56d-2bcf700ae556 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.078692 May 26 13:49:20.994199 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 30/60] 10.222.0.91 () {64 vars in 1235 bytes} [Thu May 26 13:49:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:49:21.886665 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-3527e394-c55b-4422-9127-0e956cdbf1b7 admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:21.887688 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-3527e394-c55b-4422-9127-0e956cdbf1b7 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 May 26 13:49:21.888090 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 31/61] 10.222.0.91 () {56 vars in 1074 bytes} [Thu May 26 13:49:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:49:22.082284 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-05bde15e-8216-464c-a649-0d8088dd8eb1 admin admin] Calling method '>' {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:22.102465 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-05bde15e-8216-464c-a649-0d8088dd8eb1 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.076203 May 26 13:49:22.103018 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 31/62] 10.222.0.91 () {60 vars in 1202 bytes} [Thu May 26 13:49:22 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:50:25.094466 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-3527e394-c55b-4422-9127-0e956cdbf1b7 admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:25.095475 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-3527e394-c55b-4422-9127-0e956cdbf1b7 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 26 13:50:25.095899 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 32/63] 10.222.0.91 () {54 vars in 930 bytes} [Thu May 26 13:50:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:50:25.103354 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG dbcounter [-] [103108] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:50:25.155991 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-072016f3-4779-437a-82f5-1c41cc783a88 admin admin] Calling method '>' {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:25.175893 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-072016f3-4779-437a-82f5-1c41cc783a88 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073418 May 26 13:50:25.176448 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 32/64] 10.222.0.91 () {60 vars in 1291 bytes} [Thu May 26 13:50:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:50:25.197647 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG dbcounter [-] [103107] Writing DB stats nova_api:SELECT=14 {{(pid=103107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:50:25.201772 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-955b450b-a44a-4c5c-9786-174f557885de admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:25.209452 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-955b450b-a44a-4c5c-9786-174f557885de admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013358 May 26 13:50:25.209984 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 33/65] 10.222.0.91 () {60 vars in 1282 bytes} [Thu May 26 13:50:25 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:25.221614 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-b2488162-eec6-468c-a4c1-198b2cf98cf3 admin admin] Calling method '>' {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:25.229876 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-b2488162-eec6-468c-a4c1-198b2cf98cf3 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011892 May 26 13:50:25.230398 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 33/66] 10.222.0.91 () {60 vars in 1285 bytes} [Thu May 26 13:50:25 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:25.242099 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-a198a975-9a1e-46cf-bd2b-162f82b36b53 admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:25.249809 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-a198a975-9a1e-46cf-bd2b-162f82b36b53 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011862 May 26 13:50:25.250340 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 34/67] 10.222.0.91 () {60 vars in 1285 bytes} [Thu May 26 13:50:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:25.263380 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-09b4dc31-d989-400b-8699-35be25872fad admin admin] Calling method '>' {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:25.271492 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-09b4dc31-d989-400b-8699-35be25872fad admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011656 May 26 13:50:25.272014 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 34/68] 10.222.0.91 () {60 vars in 1282 bytes} [Thu May 26 13:50:25 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:53:59.114468 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-a198a975-9a1e-46cf-bd2b-162f82b36b53 admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:59.115536 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-a198a975-9a1e-46cf-bd2b-162f82b36b53 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 26 13:53:59.116939 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 35/69] 10.222.0.91 () {56 vars in 1074 bytes} [Thu May 26 13:53:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:53:59.272894 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG dbcounter [-] [103108] Writing DB stats nova_api:SELECT=6 {{(pid=103108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:59.387113 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-9460b798-cb83-4ff1-9296-8109a4e03385 admin admin] Calling method '>' {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:59.388308 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 13:53:59.388308 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: warnings.warn(msg) May 26 13:53:59.389518 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG oslo_concurrency.lockutils [None req-9460b798-cb83-4ff1-9296-8109a4e03385 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:59.389958 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG oslo_concurrency.lockutils [None req-9460b798-cb83-4ff1-9296-8109a4e03385 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:59.390762 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG oslo_concurrency.lockutils [None req-9460b798-cb83-4ff1-9296-8109a4e03385 admin admin] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:59.391181 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG oslo_concurrency.lockutils [None req-9460b798-cb83-4ff1-9296-8109a4e03385 admin admin] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:59.424581 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-9460b798-cb83-4ff1-9296-8109a4e03385 admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.153037 May 26 13:53:59.425145 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 35/70] 10.222.0.91 () {60 vars in 1193 bytes} [Thu May 26 13:53:59 2022] GET /compute/v2.1/os-services => generated 791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:54:00.295116 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-a198a975-9a1e-46cf-bd2b-162f82b36b53 admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:00.296123 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-a198a975-9a1e-46cf-bd2b-162f82b36b53 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 May 26 13:54:00.296524 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 36/71] 10.222.0.91 () {56 vars in 1074 bytes} [Thu May 26 13:54:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:00.491549 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-26d483b8-20fc-45d6-bb5e-b4686c600ff4 admin admin] Calling method '>' {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:00.492716 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 13:54:00.492716 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: warnings.warn(msg) May 26 13:54:00.493901 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG oslo_concurrency.lockutils [None req-26d483b8-20fc-45d6-bb5e-b4686c600ff4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:00.494339 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG oslo_concurrency.lockutils [None req-26d483b8-20fc-45d6-bb5e-b4686c600ff4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:00.495108 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG oslo_concurrency.lockutils [None req-26d483b8-20fc-45d6-bb5e-b4686c600ff4 admin admin] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:00.495529 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG oslo_concurrency.lockutils [None req-26d483b8-20fc-45d6-bb5e-b4686c600ff4 admin admin] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:00.515870 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-26d483b8-20fc-45d6-bb5e-b4686c600ff4 admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079072 May 26 13:54:00.516444 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 36/72] 10.222.0.91 () {60 vars in 1193 bytes} [Thu May 26 13:54:00 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:54:11.802599 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-a198a975-9a1e-46cf-bd2b-162f82b36b53 admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:11.803617 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-a198a975-9a1e-46cf-bd2b-162f82b36b53 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 May 26 13:54:11.804019 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 37/73] 10.222.0.91 () {56 vars in 1074 bytes} [Thu May 26 13:54:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:54:11.947633 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG dbcounter [-] [103108] Writing DB stats nova_cell0:SELECT=4 {{(pid=103108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:11.948345 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG dbcounter [-] [103108] Writing DB stats nova_cell1:SELECT=4 {{(pid=103108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:11.949060 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG dbcounter [-] [103108] Writing DB stats nova_api:SELECT=8 {{(pid=103108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:11.996781 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-399baeef-499e-4579-b547-fc9aee0d8d01 admin admin] Calling method '>' {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:11.998617 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 13:54:11.998617 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: warnings.warn(msg) May 26 13:54:11.999800 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG oslo_concurrency.lockutils [None req-399baeef-499e-4579-b547-fc9aee0d8d01 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:12.000240 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG oslo_concurrency.lockutils [None req-399baeef-499e-4579-b547-fc9aee0d8d01 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:12.001040 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG oslo_concurrency.lockutils [None req-399baeef-499e-4579-b547-fc9aee0d8d01 admin admin] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:12.001496 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG oslo_concurrency.lockutils [None req-399baeef-499e-4579-b547-fc9aee0d8d01 admin admin] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:12.025882 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-399baeef-499e-4579-b547-fc9aee0d8d01 admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082541 May 26 13:54:12.026375 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 37/74] 10.222.0.91 () {60 vars in 1193 bytes} [Thu May 26 13:54:11 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:54:12.900803 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: DEBUG nova.api.openstack.wsgi [None req-a198a975-9a1e-46cf-bd2b-162f82b36b53 admin admin] Calling method '>' {{(pid=103107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:12.901845 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: INFO nova.api.openstack.requestlog [None req-a198a975-9a1e-46cf-bd2b-162f82b36b53 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 May 26 13:54:12.902246 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: [pid: 103107|app: 0|req: 38/75] 10.222.0.91 () {56 vars in 1074 bytes} [Thu May 26 13:54:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:13.094333 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG nova.api.openstack.wsgi [None req-2f436382-269c-43ec-bbd1-7e6a0a502bc5 admin admin] Calling method '>' {{(pid=103108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:13.095504 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 13:54:13.095504 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: warnings.warn(msg) May 26 13:54:13.096690 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG oslo_concurrency.lockutils [None req-2f436382-269c-43ec-bbd1-7e6a0a502bc5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:13.097132 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG oslo_concurrency.lockutils [None req-2f436382-269c-43ec-bbd1-7e6a0a502bc5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:13.097967 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG oslo_concurrency.lockutils [None req-2f436382-269c-43ec-bbd1-7e6a0a502bc5 admin admin] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:13.098514 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: DEBUG oslo_concurrency.lockutils [None req-2f436382-269c-43ec-bbd1-7e6a0a502bc5 admin admin] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:13.119908 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: INFO nova.api.openstack.requestlog [None req-2f436382-269c-43ec-bbd1-7e6a0a502bc5 admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079775 May 26 13:54:13.120400 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: [pid: 103108|app: 0|req: 38/76] 10.222.0.91 () {60 vars in 1193 bytes} [Thu May 26 13:54:13 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:55:12.306675 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: Thu May 26 13:55:12 2022 - graceful shutdown triggered... May 26 13:55:12.306159 dv-cinder-842130-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 26 13:55:12.307666 dv-cinder-842130-1-iscsi devstack@n-api.service[103107]: Gracefully killing worker 1 (pid: 103107)... May 26 13:55:12.308163 dv-cinder-842130-1-iscsi devstack@n-api.service[103108]: Gracefully killing worker 2 (pid: 103108)... May 26 13:55:13.307253 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: worker 1 buried after 1 seconds May 26 13:55:13.307253 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: worker 2 buried after 1 seconds May 26 13:55:13.307253 dv-cinder-842130-1-iscsi devstack@n-api.service[103106]: goodbye to uWSGI. May 26 13:55:13.308831 dv-cinder-842130-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 26 13:55:13.309436 dv-cinder-842130-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 26 13:55:13.312118 dv-cinder-842130-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 13:55:13.326266 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 13:55:13.340424 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 13:55:13 2022] *** May 26 13:55:13.340424 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 13:55:13.340424 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 13:55:13.340424 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: nodename: dv-cinder-842130-1-iscsi May 26 13:55:13.340424 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: machine: x86_64 May 26 13:55:13.340424 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: clock source: unix May 26 13:55:13.340424 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: pcre jit disabled May 26 13:55:13.340424 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: detected number of CPU cores: 4 May 26 13:55:13.340424 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: current working directory: / May 26 13:55:13.340424 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: detected binary path: /usr/bin/uwsgi-core May 26 13:55:13.340424 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: your processes number limit is 47680 May 26 13:55:13.341338 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: your memory page size is 4096 bytes May 26 13:55:13.341338 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: detected max file descriptor number: 2048 May 26 13:55:13.341338 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: lock engine: pthread robust mutexes May 26 13:55:13.341338 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: thunder lock: enabled May 26 13:55:13.341338 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 13:55:13.341338 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 13:55:13.388247 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: Python main interpreter initialized at 0x562263e8d9c0 May 26 13:55:13.388247 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: python threads support enabled May 26 13:55:13.388247 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: your server socket listen backlog is limited to 100 connections May 26 13:55:13.388247 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: your mercy for graceful operations on workers is 90 seconds May 26 13:55:13.388695 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: mapped 403077 bytes (393 KB) for 2 cores May 26 13:55:13.388695 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: *** Operational MODE: preforking *** May 26 13:55:13.388942 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: *** uWSGI is running in multiple interpreter mode *** May 26 13:55:13.388942 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: spawned uWSGI master process (pid: 117775) May 26 13:55:13.389174 dv-cinder-842130-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 13:55:13.390345 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: spawned uWSGI worker 1 (pid: 117787, cores: 1) May 26 13:55:13.390345 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: spawned uWSGI worker 2 (pid: 117788, cores: 1) May 26 13:55:13.390345 dv-cinder-842130-1-iscsi devstack@n-api.service[117775]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 13:55:14.592410 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 13:55:14.597339 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 13:55:15.404580 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 13:55:15.404580 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: from cryptography.utils import int_from_bytes May 26 13:55:15.405410 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 13:55:15.405410 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: from cryptography.utils import int_from_bytes May 26 13:55:15.434797 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 13:55:15.434797 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: from cryptography.utils import int_from_bytes May 26 13:55:15.435191 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 13:55:15.435191 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: from cryptography.utils import int_from_bytes May 26 13:55:17.846674 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 13:55:17.847201 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 13:55:17.847479 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 13:55:17.847734 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 13:55:17.847996 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 13:55:17.848385 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.848716 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.849038 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.849383 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.849720 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.850036 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.850360 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.850683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.851016 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.851284 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.851604 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.851934 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842130-1-iscsi {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.852260 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.852572 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.852894 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.853250 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.853562 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.853890 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.854203 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.854709 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.856537 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.856537 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.856537 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.856537 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.856537 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.856978 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.857064 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.857342 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.857669 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.857982 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.858381 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842130-1-iscsi {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.858704 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.859026 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.859334 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.859770 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.860073 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.860391 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.860706 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.861032 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.861407 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.861753 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.862079 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.862404 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.862744 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.863044 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.863346 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.863659 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.863997 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.864296 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.864604 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.864855 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.865241 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.865576 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.865901 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.866226 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.866487 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.866731 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.867049 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.867373 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.867685 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.868007 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.868301 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.868610 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.868929 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.869270 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.869563 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.869869 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.870188 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.870507 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.870834 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.871147 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.871471 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.871880 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.91 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.872129 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.91 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.872438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.872783 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.873106 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.873447 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.873770 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.874100 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.874401 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.874711 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.875025 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.875343 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.875671 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.875979 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.876231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.876536 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.876843 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.877214 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.877528 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.877838 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.878149 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.878451 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.878757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.879065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.879371 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.879685 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.879988 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.880295 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.880603 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.880912 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.881242 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.881566 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.881894 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.882203 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.882512 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.882821 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.883185 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 13:55:17.883727 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.883916 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 13:55:17.884072 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.884072 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.884719 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 13:55:17.884873 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.885030 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 13:55:17.885221 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.885374 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 13:55:17.885564 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.885717 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.885870 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.886014 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.886174 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.886174 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.886464 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.886610 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.886765 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.886919 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.887073 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.887229 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.887371 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.887531 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.887686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.887829 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.887978 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.888131 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.888620 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.888783 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.888934 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.889105 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.889298 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.889463 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.889779 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842130-1-iscsi {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.889946 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.890098 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.890318 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.890477 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.890632 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.890799 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.894348 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.894538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.894693 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.894841 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.894988 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.895144 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.895298 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.895449 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.895592 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.895592 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.895873 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.896058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.896211 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.896361 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.896524 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.896674 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.896825 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.896985 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.897135 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.897333 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.897488 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.897658 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.897950 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.898135 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.898283 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.898283 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.898930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.898930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.899226 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.899380 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.899524 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.899685 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.900026 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842130-1-iscsi {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.900187 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.900348 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.900587 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.900734 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.900884 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.901034 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.901218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.901218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.901549 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.901714 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.901858 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.902014 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.902167 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.902320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.902469 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.902631 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.902773 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.902929 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.903080 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.903230 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.903381 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.903540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.903682 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.903836 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.903986 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.904137 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.904307 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.904624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.905046 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.905245 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.905459 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.905610 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.905760 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.905929 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.906182 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.906347 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.906501 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.906645 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.906802 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.906802 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.907115 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.907267 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.907416 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.907559 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.907708 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.907859 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.908018 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.908161 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.908343 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.909400 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.909575 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.909859 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.910252 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.910412 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.910586 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.910810 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.910968 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.911122 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.911274 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.911417 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.911559 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.911714 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.911867 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.912017 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.912170 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.912320 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.912462 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.912604 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.912760 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.912915 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.913058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.913234 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.913395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.913539 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.913691 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.913841 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.913992 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.914147 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.914289 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.914431 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.914770 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.914934 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.915079 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.915222 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.91 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.915364 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.915524 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.91 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.915677 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.915829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.915973 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.916115 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.916268 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.916425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.916577 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.916721 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.916871 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.917015 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.917194 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.917363 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.917514 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.917692 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.917834 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.917977 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.918133 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.918290 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.918447 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.918590 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.918740 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.918890 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.919033 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.919488 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.919651 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.919802 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.919952 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.920122 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.920428 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.920588 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.920738 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.920977 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.921137 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.921306 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.921462 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.921621 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.921776 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.921920 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.922061 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.922205 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.922361 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.922522 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.922675 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.922826 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.922977 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.923126 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.923277 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.923429 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.923572 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.923725 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.923876 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.924029 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.924180 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.924338 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.924481 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.924634 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.924755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.925001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.925092 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.925220 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.925311 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.925442 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.925544 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.925625 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.925705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.925785 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.925858 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.925934 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.926006 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.926090 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.926162 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.926239 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.926362 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.926447 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.926520 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.926590 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.926667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.926746 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.926818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.926900 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.926972 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.927042 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.927119 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.927190 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.927273 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.927354 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.927434 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.927519 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.927598 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.927670 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.927752 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.927831 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.927902 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.927972 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.928049 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.928121 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.928200 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.928282 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.928360 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.928438 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.928438 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.928438 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.928438 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.928702 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.928807 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.928882 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.928952 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.928952 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.929104 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.929206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.929706 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.929784 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.929863 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.929948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.930022 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.930100 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.930172 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.930263 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.930365 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.930623 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.930703 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.930782 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:55:17.930855 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.930925 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.931017 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.931103 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.931182 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.931260 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.931341 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.931412 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.931482 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.931641 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.931726 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.931726 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.931855 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.931937 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.932022 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.932095 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.932171 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.932248 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.932325 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.932404 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.932492 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.932572 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.932657 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.932657 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.932796 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.932872 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.932957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.933042 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.933127 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.933355 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.933435 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.933677 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.933779 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.934001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.934083 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.934312 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.934408 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.934632 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.934722 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.934970 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.935076 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.935257 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.935351 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.935580 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.935670 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.935896 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.935979 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.936211 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.936298 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.936525 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.936653 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.936856 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.936959 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.937191 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.937362 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.937513 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.937610 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.937824 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.937925 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.938143 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.938244 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.938476 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.938576 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.938792 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.938892 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.939110 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.939214 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.939424 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.939806 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.939907 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.939993 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.940086 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.940180 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.940377 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.940476 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.940728 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.940843 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.940994 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.941099 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.941342 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.941490 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.941662 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.941763 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.941979 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.942082 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.942294 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.942422 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.942607 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.942698 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.942917 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.943010 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.943234 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.943348 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.943550 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.943663 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.943856 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.943958 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.944163 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.944264 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.944472 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.944564 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.944784 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.944877 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.945096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.945257 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.945456 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.945561 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.945766 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.945868 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.946079 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.946183 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.946387 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.946493 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.946711 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.946811 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.947023 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.947115 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.947330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.947438 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.947639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.947762 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.947941 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.948035 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.948254 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.948358 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.948568 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.948671 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.948882 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.948973 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.949224 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.949340 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.949540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.949649 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.950015 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.950119 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.950215 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.950308 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.950453 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.950554 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.950766 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.950882 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.951085 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.951189 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.951396 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.951489 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.951712 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.951804 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.952025 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.952118 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.952338 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.952440 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.952649 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.952749 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.952960 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.953053 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.953307 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.953402 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.953624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.953744 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.953930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.954023 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.954240 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.954410 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.954548 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.954755 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.954856 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.955071 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.955875 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.955997 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.956281 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.956374 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.956615 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.956698 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.956931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.957013 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.957271 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.957413 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.957584 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.957704 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.957895 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.958015 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.958206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.958333 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.958521 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.958649 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.958832 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.958959 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.959142 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.959354 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.959468 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.959585 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.959750 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.960165 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.960165 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.960384 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.960493 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.960612 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.960730 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.960859 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.961046 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.961330 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.961453 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.961577 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.961697 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.961815 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.961933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.962053 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.962164 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.962308 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.962430 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.962658 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.962776 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.963003 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.963121 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.963328 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.963446 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.963644 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.963849 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.963963 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.964083 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.964264 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.964391 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.964575 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.964699 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.964880 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.965009 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.965204 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.965340 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.965513 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.965640 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.965927 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.966065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.966179 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.966286 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.966469 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.966604 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.966786 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.966915 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.967117 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.967237 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.967457 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.967615 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.967742 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.967861 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.968036 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.968157 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.968343 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.968470 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.968651 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.968771 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.968957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.969084 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.969307 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.969442 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.969619 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.969738 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.969923 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.970058 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.970438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.970559 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.970679 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.971632 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.971759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.971878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.971995 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.972119 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.972237 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.972348 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.972458 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.972567 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.972787 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.972915 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.973034 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.973192 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.973324 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.973465 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.973640 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.973771 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.973973 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.974099 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.974212 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.974329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.974476 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.974610 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.974722 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.974833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.974949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.975128 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.975258 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.976163 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.976304 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.976426 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.976661 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.976798 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.976926 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.977038 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.977183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.977300 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.977422 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.977534 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.977657 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.977777 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.977887 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.978004 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.978115 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.978225 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.978346 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.978464 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.978574 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.978574 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.978778 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.978900 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.979011 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.979120 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.979228 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.979410 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.979530 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.979720 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.979856 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.980042 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.980168 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.980557 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.980678 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.980799 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.980918 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.981028 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.981135 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.981289 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.981421 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.981566 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.981865 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.981999 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.982111 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.982227 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.982350 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.982461 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.982570 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.982729 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.982849 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.983032 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.983199 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.983321 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.983478 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.983641 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.983764 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.984024 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.984168 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.984281 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.984398 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.984545 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.984666 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.984851 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.984980 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.985175 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.985298 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.985532 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.985654 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.985843 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.985964 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.986162 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.986409 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.986530 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.986641 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.986808 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.986937 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.987586 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.987725 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.987839 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.987948 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.987948 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.988167 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.988287 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.988398 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.988514 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.988638 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.988990 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.989116 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.989284 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.989410 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.989410 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.989615 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.989615 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.989815 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.990031 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.991057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.991187 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.991307 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.991428 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.991540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.991661 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.991792 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.991792 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.992209 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.992327 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.992453 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.992453 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.992668 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.992778 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.992895 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.993006 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.993125 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.993330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.993456 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.993574 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.993693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.993804 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.993922 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.994044 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.994270 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.994401 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.994515 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.994632 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.994632 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.994854 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.994964 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.995086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.995197 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.995306 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.995422 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.995533 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.995688 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.995887 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.996009 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.996121 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.996329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.996555 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.996675 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.996795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.996914 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.997024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.997302 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.997437 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.997548 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.997674 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.997818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.997957 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.998192 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.998335 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.998460 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.998582 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.998708 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.999008 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.999346 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.999472 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.999672 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.999825 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:17.999937 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.000109 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.000257 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.000377 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.000377 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.000988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.000988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.001470 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.001470 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.001692 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.001816 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.001937 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.001937 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.003272 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.003397 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.003524 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.003524 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.003738 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.003848 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.003981 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.004116 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.004237 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.004323 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.004402 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.004627 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.004727 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.004812 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.004912 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.005000 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.005091 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.005251 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.005356 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.005452 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.005538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.005676 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.005770 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.005855 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.005960 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.006043 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.006123 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.006205 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.006287 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.006516 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.006612 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.006815 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.006917 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.007128 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.007246 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.007432 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.007564 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.007743 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.007876 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.008051 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.008203 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.008631 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.008737 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.008820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.008902 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.008987 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.009131 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.009293 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.009467 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.009609 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.009780 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.009928 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.010106 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.010224 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.010433 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.010518 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.010780 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.011070 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.011178 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.011266 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.011364 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.011475 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.011692 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.011786 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.012000 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.012102 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.012319 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.012433 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.012632 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.012732 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.012942 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.013070 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.013308 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.013410 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.013598 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.013704 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.013908 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.014019 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.014216 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.014310 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.014529 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.014639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.014842 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.014962 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.015148 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.015240 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.015462 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.015564 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.015779 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.015886 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.016105 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.016197 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.016411 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.016500 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.016724 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.016824 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.017032 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.017124 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.017367 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.017473 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.018185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.018285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.018496 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.018589 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.018802 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.018901 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.019110 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.019204 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.019419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.019513 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.019729 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.019831 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.020038 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.020138 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.020360 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.020457 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.020669 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.020775 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.020978 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.021361 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.021461 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.021547 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.021631 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.021735 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.021901 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.021994 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.022210 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.022330 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.022554 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.022661 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.022863 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.022963 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.023187 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.023279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.023510 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.023615 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.023826 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.023921 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.024139 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.024238 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.024455 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.024548 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.024766 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.024878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.025089 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.025204 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.025431 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.025535 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.025757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.025851 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.026062 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.026155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.026369 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.026470 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.026681 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.026774 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.026987 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.027090 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.027293 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.027386 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.027598 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.027699 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.027906 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.028008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.028211 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.028303 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.028513 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.028606 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.028819 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.028922 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.029135 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.029276 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.029476 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.029607 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.030062 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.030380 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.030708 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.030928 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.031031 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.031265 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.031379 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.031572 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.031888 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.032204 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.032556 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.032867 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.033246 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.034000 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.034141 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.034387 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.034493 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.034730 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.034832 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.035073 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.035244 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.035581 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.035686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.035908 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.036004 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.036270 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.036374 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.036679 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.036783 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.037045 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.037144 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.037328 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.037426 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.037826 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.037943 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.038156 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.038295 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.038479 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.038620 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.038943 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.039045 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.039262 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.039357 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.039586 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.039681 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.039929 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.040158 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.040254 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.040492 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.040594 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.040812 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.040915 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.041129 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.041248 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.041466 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.041565 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.041785 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.042102 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.042415 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.042700 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.042807 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.043026 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.043120 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.043337 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.043433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.043660 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.043760 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.043978 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.044082 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.044291 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.044393 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.044609 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.044703 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.044939 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.045041 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.045281 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.045383 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.045603 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.045707 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.045920 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.046024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.046282 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.046379 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.046600 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.046712 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.046915 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.047036 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.047234 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.047360 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.047555 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.047673 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.047922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.048073 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.048188 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.048389 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.048493 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.048710 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.048839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.049093 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.049228 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.049433 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.049536 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.049746 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.049842 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.050062 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.050163 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.050379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.050479 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.050697 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.050793 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.051032 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.051136 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.051357 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.051460 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.051673 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.051769 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.051991 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.052098 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.052374 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.052490 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.052633 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.052831 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.052963 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.053166 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.053401 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.053515 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.053721 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.053824 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.054050 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.054166 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.054438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.054544 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.054755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.054849 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.055082 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.055176 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.055393 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.055497 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.055701 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.055803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.056013 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.056106 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.056320 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.056415 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.056625 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.056719 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.056932 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.057024 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.057334 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.057443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.057614 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.057734 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.057894 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.057988 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.058205 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.058305 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.058516 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.058741 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.058842 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.059092 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.059195 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.059409 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.059511 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.059735 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.059836 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.060043 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.060146 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.060366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.060460 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.060675 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.060769 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.061000 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.061094 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.061334 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.061428 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.061643 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.061737 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.061962 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.062064 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.062281 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.062389 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.062590 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.062704 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.062896 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.062992 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.063209 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.063303 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.063518 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.063621 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.063825 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.063920 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.064137 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.064232 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.064455 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.064561 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.064790 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.064892 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.065099 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.065222 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.065432 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.065542 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.065740 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.065844 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.066051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.066154 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.066357 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.066460 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.066665 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.066761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.066970 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.067063 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.067275 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.067385 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.067591 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.067719 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.067897 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.068029 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.068208 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.068325 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.068512 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.068627 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.068821 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.068925 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.069126 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.069250 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.069461 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.069555 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.069783 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.069881 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.070092 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.070188 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.070400 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.070539 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.070721 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.070834 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.071039 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.071133 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.071343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.071437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.071650 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.071753 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.071956 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.072050 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.072276 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.072400 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.072612 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.072727 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.072929 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.073029 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.073268 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.073489 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.073596 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.073826 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.073937 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.074151 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.074253 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.074486 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.074589 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.074819 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.074920 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.075130 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.075224 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.075439 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.075541 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.075748 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.075842 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.076064 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.076156 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.076377 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.076484 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.076689 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.076783 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.076999 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.077099 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.077334 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.077442 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.077651 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.077767 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.077967 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.078089 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.078280 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.078574 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.078670 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.078889 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.078983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.079200 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.079309 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.079511 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.079621 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.079823 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.079917 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.080641 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.080820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.080959 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.081062 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.081350 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.081461 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.081670 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.081774 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.081987 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.082082 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.082304 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.082420 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.082630 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.082737 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.082943 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.083078 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.083257 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.083353 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.083568 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.083660 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.083878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.083962 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.084192 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.084297 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.084513 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.084614 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.084830 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.084929 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.085138 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.085270 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.085521 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.085623 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.085836 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.085930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.086154 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.086258 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.086475 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.086568 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.086793 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.086895 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.087106 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.087204 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.087421 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.087515 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.087734 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.087852 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.088050 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.088177 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.088357 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.088450 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.088666 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.088773 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.088981 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.089076 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.089354 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.089461 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.089683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.089796 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.089991 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.090085 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.090297 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.090401 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.090601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.090705 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.090914 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.091023 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.091234 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.091335 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.091545 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.091772 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.091874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.092093 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.092194 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.092433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.092542 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.092746 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.092873 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.093057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.093188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.093390 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.093561 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.093696 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.093791 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.094003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.094099 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.094306 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.094415 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.094611 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.094712 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.094916 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.095020 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.095221 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.095326 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.095528 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.095637 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.096381 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.096585 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.096738 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.096910 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.097007 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.097246 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.097356 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.097575 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.097684 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.097893 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.098000 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.098198 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.098471 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.098568 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.098827 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.098932 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.099149 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.099244 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.099471 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.099573 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.099782 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.099876 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.100106 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.100202 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.100414 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.100517 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.100736 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.100836 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.101044 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.101171 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.101383 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.101515 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.101693 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.101789 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.102008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.102131 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.102312 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.102425 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.102622 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.102724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.102931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.103035 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.103245 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.103360 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.103551 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.103652 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.103861 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.103955 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.104167 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.104263 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.104493 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.104588 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.104799 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.104900 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.105106 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.105247 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.105444 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.105546 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.105758 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.105860 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.106057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.106171 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.106371 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.106467 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.106690 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.106792 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.107003 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.107098 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.107312 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.107404 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.107615 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.107718 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.107926 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.108021 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.108231 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.108334 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.108543 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.108642 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.108850 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.108953 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.109196 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.109296 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.109516 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.109624 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.109831 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.109925 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.110161 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.110256 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.110489 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.110585 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.110827 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.110928 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.111144 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.111235 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.111516 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.111615 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.111848 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.111942 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.112166 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.112259 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.112479 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.112583 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.112793 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.112888 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.113039 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 13:55:18.113364 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.113701 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.114026 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.114362 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.114696 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.115006 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.115316 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.115626 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.115953 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.116270 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.116583 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.116897 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.117231 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.117545 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.117858 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.118171 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.118482 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.118794 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.119105 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.119416 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.119728 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.120043 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.120359 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.120701 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.121021 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.121363 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.121683 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.121999 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.122312 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.122624 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.122933 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.123243 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.123562 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.123893 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.124208 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.124517 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.124938 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.125279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.125603 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.125924 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.126236 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.126561 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.126886 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.127303 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.127627 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.127941 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.128271 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.128610 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.128940 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.129288 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.129601 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.129915 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.130239 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.130553 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.130872 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.131185 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.131492 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.131797 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.132108 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.132412 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.132716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.133023 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.133355 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.133666 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.133972 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.134280 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.134586 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.134891 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.135198 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.135504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.135815 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.136120 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.136428 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.136730 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.137035 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.137363 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.137696 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.138032 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.138374 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.138699 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.139010 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.139331 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.139640 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.139971 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.140294 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.140610 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.140920 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.141275 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.141589 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.141898 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.142209 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.142520 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.143422 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.143737 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.144064 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.144507 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.144823 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.145160 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.145514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.145837 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.146154 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.146466 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.146798 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.147110 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.147422 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.147736 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.148048 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.148361 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.148678 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.148996 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.149359 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.149690 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.150006 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.150335 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.150663 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.151010 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.151325 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.151670 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.151999 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.152315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.152629 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.152934 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:55:18.153204 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 13:55:18.173769 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO dbcounter [None req-d3c376e4-e610-4ab5-b29d-d564d9623e63 None None] Registered counter for database nova_api May 26 13:55:18.194452 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_db.sqlalchemy.engines [None req-d3c376e4-e610-4ab5-b29d-d564d9623e63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:55:18.202024 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writer thread running {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:55:18.216805 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO dbcounter [None req-0f21d2c8-1701-42cb-960d-79a64363c591 None None] Registered counter for database nova_api May 26 13:55:18.237625 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_db.sqlalchemy.engines [None req-0f21d2c8-1701-42cb-960d-79a64363c591 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:55:18.244983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writer thread running {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:55:18.259838 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.context [None req-d3c376e4-e610-4ab5-b29d-d564d9623e63 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1cef31d3-1884-4927-928a-7d3f347ed78a(cell1) {{(pid=117788) load_cells /opt/stack/nova/nova/context.py:464}} May 26 13:55:18.264005 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d3c376e4-e610-4ab5-b29d-d564d9623e63 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:18.265626 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d3c376e4-e610-4ab5-b29d-d564d9623e63 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:18.266439 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d3c376e4-e610-4ab5-b29d-d564d9623e63 None None] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:18.268463 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d3c376e4-e610-4ab5-b29d-d564d9623e63 None None] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:18.270461 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO dbcounter [None req-d3c376e4-e610-4ab5-b29d-d564d9623e63 None None] Registered counter for database nova_cell0 May 26 13:55:18.274496 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO dbcounter [None req-d3c376e4-e610-4ab5-b29d-d564d9623e63 None None] Registered counter for database nova_cell1 May 26 13:55:18.281952 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_db.sqlalchemy.engines [None req-d3c376e4-e610-4ab5-b29d-d564d9623e63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:55:18.284227 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_db.sqlalchemy.engines [None req-d3c376e4-e610-4ab5-b29d-d564d9623e63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:55:18.290783 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writer thread running {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:55:18.292833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writer thread running {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:55:18.303350 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.context [None req-0f21d2c8-1701-42cb-960d-79a64363c591 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1cef31d3-1884-4927-928a-7d3f347ed78a(cell1) {{(pid=117787) load_cells /opt/stack/nova/nova/context.py:464}} May 26 13:55:18.307531 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f21d2c8-1701-42cb-960d-79a64363c591 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:18.309124 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f21d2c8-1701-42cb-960d-79a64363c591 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:18.309963 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f21d2c8-1701-42cb-960d-79a64363c591 None None] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:18.311965 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f21d2c8-1701-42cb-960d-79a64363c591 None None] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:18.313948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO dbcounter [None req-0f21d2c8-1701-42cb-960d-79a64363c591 None None] Registered counter for database nova_cell0 May 26 13:55:18.318060 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO dbcounter [None req-0f21d2c8-1701-42cb-960d-79a64363c591 None None] Registered counter for database nova_cell1 May 26 13:55:18.325323 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_db.sqlalchemy.engines [None req-0f21d2c8-1701-42cb-960d-79a64363c591 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:55:18.327051 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_db.sqlalchemy.engines [None req-0f21d2c8-1701-42cb-960d-79a64363c591 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:55:18.333030 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writer thread running {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:55:18.335234 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writer thread running {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:55:18.441780 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO dbcounter [None req-d3c376e4-e610-4ab5-b29d-d564d9623e63 None None] Registered counter for database nova_cell0 May 26 13:55:18.448361 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_db.sqlalchemy.engines [None req-d3c376e4-e610-4ab5-b29d-d564d9623e63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:55:18.452746 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writer thread running {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:55:18.484739 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO dbcounter [None req-0f21d2c8-1701-42cb-960d-79a64363c591 None None] Registered counter for database nova_cell0 May 26 13:55:18.493581 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_db.sqlalchemy.engines [None req-0f21d2c8-1701-42cb-960d-79a64363c591 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:55:18.498304 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writer thread running {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:55:18.779606 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: WARNING keystonemiddleware.auth_token [None req-d3c376e4-e610-4ab5-b29d-d564d9623e63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 13:55:18.787253 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: WARNING keystonemiddleware.auth_token [None req-d3c376e4-e610-4ab5-b29d-d564d9623e63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 13:55:18.829947 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: WARNING keystonemiddleware.auth_token [None req-0f21d2c8-1701-42cb-960d-79a64363c591 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 13:55:18.837830 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: WARNING keystonemiddleware.auth_token [None req-0f21d2c8-1701-42cb-960d-79a64363c591 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 13:55:19.136011 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: WARNING keystonemiddleware.auth_token [None req-d3c376e4-e610-4ab5-b29d-d564d9623e63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 13:55:19.143794 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: WARNING keystonemiddleware.auth_token [None req-d3c376e4-e610-4ab5-b29d-d564d9623e63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 13:55:19.149213 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562263e8d9c0 pid: 117788 (default app) May 26 13:55:19.192518 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: WARNING keystonemiddleware.auth_token [None req-0f21d2c8-1701-42cb-960d-79a64363c591 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 13:55:19.198637 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: WARNING keystonemiddleware.auth_token [None req-0f21d2c8-1701-42cb-960d-79a64363c591 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 13:55:19.204025 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562263e8d9c0 pid: 117787 (default app) May 26 13:55:59.983894 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:59.986254 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:59.987658 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:59.989009 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:01.060519 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7a24d125-4f0d-4019-b9e6-a8a51d8ed3d8 tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] Action: 'create', calling method: .version_select at 0x7f25a6aadc10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-150422979", "metadata": {"Type": "work"}}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:01.096379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7a24d125-4f0d-4019-b9e6-a8a51d8ed3d8 tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] Request method failure captured: May 26 13:56:01.096379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 13:56:01.096379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 13:56:01.096379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 13:56:01.096379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 13:56:01.096379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 121 May 26 13:56:01.096379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 13:56:01.096379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 13:56:01.096379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 13:56:01.096379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 13:56:01.096379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4bvkURIjNVageBrJ1XKzKZQtpa7YB7t3wC7xfoVHF71RAWYlhYEdsZsb1ap7yTZTTlEi1yn7RVLq-X96henRZVjX-DpV-OaJVD1fCptgnTTPLFHVJrA9y2He014n5oMMO2sWMtKjw_PlN7twsbIizCunhtC1-6FIsM_be69tJ5Y1b8 May 26 13:56:01.096379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 13:56:01.096379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 13:56:01.096379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 13:56:01.096379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 13:56:01.096379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 13:56:01.096379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 13:56:01.096379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: 67bf852b45d8419aad80b70b02e2bf29 May 26 13:56:01.096379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-VolumesNegativeTest-258947951 May 26 13:56:01.096379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 13:56:01.096379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 13:56:01.097877 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/67bf852b45d8419aad80b70b02e2bf29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/67bf852b45d8419aad80b70b02e2bf29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/67bf852b45d8419aad80b70b02e2bf29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_67bf852b45d8419aad80b70b02e2bf29", "adminURL": "http://10.222.0.91:8080"}]}] May 26 13:56:01.097877 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-VolumesNegativeTest-258947951 May 26 13:56:01.097877 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 67bf852b45d8419aad80b70b02e2bf29 May 26 13:56:01.097877 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-VolumesNegativeTest-258947951 May 26 13:56:01.097877 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-VolumesNegativeTest-258947951-project May 26 13:56:01.097877 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 13:56:01.097877 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 13:56:01.097877 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: b6e1ee20eef14ec3bf13d7473f28fbcb May 26 13:56:01.097877 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-VolumesNegativeTest-258947951-project May 26 13:56:01.097877 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: May 26 13:56:01.097877 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-150422979", "metadata": {"Type": "work"}}} May 26 13:56:01.097877 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: May 26 13:56:01.097877 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 13:56:01.098839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-150422979', 'metadata': {'Type': 'work'}}}} May 26 13:56:01.098839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:56:01.098839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:56:01.098839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 13:56:01.098839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 13:56:01.098839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 13:56:01.098839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise error May 26 13:56:01.098839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 26 13:56:01.098839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:56:01.098839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 13:56:01.098839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 13:56:01.098839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:56:01.098839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 13:56:01.098839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi '#$%' May 26 13:56:01.098839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:56:01.098839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:56:01.098839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:56:01.098839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:56:01.098839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:56:01.098839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:56:01.098839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:56:01.098839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:56:01.100602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 13:56:01.100602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 13:56:01.100602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:56:01.100602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:56:01.100602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 13:56:01.100602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 13:56:01.100602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 13:56:01.100602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 13:56:01.100602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 13:56:01.100602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 13:56:01.100602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 13:56:01.100602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:56:01.100602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:56:01.100602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:56:01.100602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:56:01.100602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:56:01.100602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:56:01.100602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 13:56:01.100602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 13:56:01.102025 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 13:56:01.102025 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:56:01.102025 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7a24d125-4f0d-4019-b9e6-a8a51d8ed3d8 tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:56:01.102025 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7a24d125-4f0d-4019-b9e6-a8a51d8ed3d8 tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.120348 May 26 13:56:01.102025 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 1/1] 10.222.0.91 () {60 vars in 1155 bytes} [Thu May 26 13:55:59 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 13:56:01.560631 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e1b79ff3-d6c0-4166-9e8b-460a613a1c10 tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] Action: 'create', calling method: .version_select at 0x7f25a7435280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1857584807", "metadata": {"Type": "work"}}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:01.579761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e1b79ff3-d6c0-4166-9e8b-460a613a1c10 tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] Request method failure captured: May 26 13:56:01.579761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 13:56:01.579761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 13:56:01.579761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 13:56:01.579761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 13:56:01.579761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 120 May 26 13:56:01.579761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 13:56:01.579761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 13:56:01.579761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 13:56:01.579761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 13:56:01.579761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4bvkURIjNVageBrJ1XKzKZQtpa7YB7t3wC7xfoVHF71RAWYlhYEdsZsb1ap7yTZTTlEi1yn7RVLq-X96henRZVjX-DpV-OaJVD1fCptgnTTPLFHVJrA9y2He014n5oMMO2sWMtKjw_PlN7twsbIizCunhtC1-6FIsM_be69tJ5Y1b8 May 26 13:56:01.579761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 13:56:01.579761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 13:56:01.579761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 13:56:01.579761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 13:56:01.579761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 13:56:01.579761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 13:56:01.579761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: 67bf852b45d8419aad80b70b02e2bf29 May 26 13:56:01.579761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesNegativeTest-258947951 May 26 13:56:01.579761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 13:56:01.579761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 13:56:01.581267 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/67bf852b45d8419aad80b70b02e2bf29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/67bf852b45d8419aad80b70b02e2bf29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/67bf852b45d8419aad80b70b02e2bf29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_67bf852b45d8419aad80b70b02e2bf29", "adminURL": "http://10.222.0.91:8080"}]}] May 26 13:56:01.581267 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesNegativeTest-258947951 May 26 13:56:01.581267 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 67bf852b45d8419aad80b70b02e2bf29 May 26 13:56:01.581267 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesNegativeTest-258947951 May 26 13:56:01.581267 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesNegativeTest-258947951-project May 26 13:56:01.581267 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 13:56:01.581267 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 13:56:01.581267 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: b6e1ee20eef14ec3bf13d7473f28fbcb May 26 13:56:01.581267 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesNegativeTest-258947951-project May 26 13:56:01.581267 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: May 26 13:56:01.581267 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1857584807", "metadata": {"Type": "work"}}} May 26 13:56:01.581267 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: May 26 13:56:01.581267 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 13:56:01.582059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1857584807', 'metadata': {'Type': 'work'}}}} May 26 13:56:01.582059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:56:01.582059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:56:01.582059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 13:56:01.582059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 13:56:01.582059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 13:56:01.582059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise error May 26 13:56:01.582059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 26 13:56:01.582059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:56:01.582059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 26 13:56:01.582059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 13:56:01.582059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:56:01.582059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 13:56:01.582059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi '0' May 26 13:56:01.582059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:56:01.582059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:56:01.582059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:56:01.582059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:56:01.582059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:56:01.582059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:56:01.582059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:56:01.582059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:56:01.583392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 13:56:01.583392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 13:56:01.583392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:56:01.583392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:56:01.583392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 13:56:01.583392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 13:56:01.583392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 13:56:01.583392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 13:56:01.583392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 13:56:01.583392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 13:56:01.583392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 13:56:01.583392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:56:01.583392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:56:01.583392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:56:01.583392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:56:01.583392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:56:01.583392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:56:01.583392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 13:56:01.583392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 13:56:01.584495 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 13:56:01.584495 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:56:01.586270 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e1b79ff3-d6c0-4166-9e8b-460a613a1c10 tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:56:01.588552 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e1b79ff3-d6c0-4166-9e8b-460a613a1c10 tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.483905 May 26 13:56:01.593351 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 1/2] 10.222.0.91 () {60 vars in 1155 bytes} [Thu May 26 13:56:01 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 490 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 26 13:56:01.603862 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-959c377a-1914-4415-9286-71cebca6eeff tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] Action: 'create', calling method: .version_select at 0x7f25a6999ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-734727565", "metadata": {"Type": "work"}}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:01.607705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-959c377a-1914-4415-9286-71cebca6eeff tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] Request method failure captured: May 26 13:56:01.607705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 13:56:01.607705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 13:56:01.607705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 13:56:01.607705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 13:56:01.607705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 118 May 26 13:56:01.607705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 13:56:01.607705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 13:56:01.607705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 13:56:01.607705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 13:56:01.607705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4bvkURIjNVageBrJ1XKzKZQtpa7YB7t3wC7xfoVHF71RAWYlhYEdsZsb1ap7yTZTTlEi1yn7RVLq-X96henRZVjX-DpV-OaJVD1fCptgnTTPLFHVJrA9y2He014n5oMMO2sWMtKjw_PlN7twsbIizCunhtC1-6FIsM_be69tJ5Y1b8 May 26 13:56:01.607705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 13:56:01.607705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 13:56:01.607705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 13:56:01.607705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 13:56:01.607705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 13:56:01.607705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 13:56:01.607705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: 67bf852b45d8419aad80b70b02e2bf29 May 26 13:56:01.607705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-VolumesNegativeTest-258947951 May 26 13:56:01.607705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 13:56:01.607705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 13:56:01.609142 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/67bf852b45d8419aad80b70b02e2bf29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/67bf852b45d8419aad80b70b02e2bf29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/67bf852b45d8419aad80b70b02e2bf29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_67bf852b45d8419aad80b70b02e2bf29", "adminURL": "http://10.222.0.91:8080"}]}] May 26 13:56:01.609142 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-VolumesNegativeTest-258947951 May 26 13:56:01.609142 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 67bf852b45d8419aad80b70b02e2bf29 May 26 13:56:01.609142 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-VolumesNegativeTest-258947951 May 26 13:56:01.609142 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-VolumesNegativeTest-258947951-project May 26 13:56:01.609142 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 13:56:01.609142 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 13:56:01.609142 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: b6e1ee20eef14ec3bf13d7473f28fbcb May 26 13:56:01.609142 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-VolumesNegativeTest-258947951-project May 26 13:56:01.609142 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: May 26 13:56:01.609142 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-734727565", "metadata": {"Type": "work"}}} May 26 13:56:01.609142 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: May 26 13:56:01.609142 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 13:56:01.610117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-734727565', 'metadata': {'Type': 'work'}}}} May 26 13:56:01.610117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:56:01.610117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:56:01.610117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 13:56:01.610117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 13:56:01.610117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 13:56:01.610117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise error May 26 13:56:01.610117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 26 13:56:01.610117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:56:01.610117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 13:56:01.610117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 13:56:01.610117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:56:01.610117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 13:56:01.610117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi '' May 26 13:56:01.610117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:56:01.610117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:56:01.610117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:56:01.610117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:56:01.610117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:56:01.610117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:56:01.610117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:56:01.610117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:56:01.611427 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 13:56:01.611427 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 13:56:01.611427 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:56:01.611427 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:56:01.611427 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 13:56:01.611427 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 13:56:01.611427 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 13:56:01.611427 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 13:56:01.611427 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 13:56:01.611427 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 13:56:01.611427 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 13:56:01.611427 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:56:01.611427 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:56:01.611427 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:56:01.611427 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:56:01.611427 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:56:01.611427 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:56:01.611427 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 13:56:01.611427 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 13:56:01.612479 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 13:56:01.612479 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:56:01.614702 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-959c377a-1914-4415-9286-71cebca6eeff tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:56:01.615535 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-959c377a-1914-4415-9286-71cebca6eeff tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016128 May 26 13:56:01.625281 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 2/3] 10.222.0.91 () {60 vars in 1155 bytes} [Thu May 26 13:56:01 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 13:56:01.626518 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:01.627956 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:01.629096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:01.630395 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:01.636518 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9f45fb81-305b-4492-9d65-3cf23879f05b tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] Calling method '.version_select at 0x7f25a6aef160>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:03.310259 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-9f45fb81-305b-4492-9d65-3cf23879f05b tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] HTTP exception thrown: Volume tempest-invalid-1758260635 could not be found. May 26 13:56:03.314278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9f45fb81-305b-4492-9d65-3cf23879f05b tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] Request method failure captured: May 26 13:56:03.314278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1758260635 HTTP/1.1 May 26 13:56:03.314278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 13:56:03.314278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 13:56:03.314278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 13:56:03.314278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 13:56:03.314278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 13:56:03.314278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 13:56:03.314278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 13:56:03.314278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 13:56:03.314278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4bvkURIjNVageBrJ1XKzKZQtpa7YB7t3wC7xfoVHF71RAWYlhYEdsZsb1ap7yTZTTlEi1yn7RVLq-X96henRZVjX-DpV-OaJVD1fCptgnTTPLFHVJrA9y2He014n5oMMO2sWMtKjw_PlN7twsbIizCunhtC1-6FIsM_be69tJ5Y1b8 May 26 13:56:03.314278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 13:56:03.314278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 13:56:03.314278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 13:56:03.314278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 13:56:03.314278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 13:56:03.314278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 13:56:03.314278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: 67bf852b45d8419aad80b70b02e2bf29 May 26 13:56:03.314278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesNegativeTest-258947951 May 26 13:56:03.314278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 13:56:03.314278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 13:56:03.315578 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/67bf852b45d8419aad80b70b02e2bf29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/67bf852b45d8419aad80b70b02e2bf29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/67bf852b45d8419aad80b70b02e2bf29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_67bf852b45d8419aad80b70b02e2bf29", "adminURL": "http://10.222.0.91:8080"}]}] May 26 13:56:03.315578 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesNegativeTest-258947951 May 26 13:56:03.315578 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 67bf852b45d8419aad80b70b02e2bf29 May 26 13:56:03.315578 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesNegativeTest-258947951 May 26 13:56:03.315578 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesNegativeTest-258947951-project May 26 13:56:03.315578 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 13:56:03.315578 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 13:56:03.315578 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: b6e1ee20eef14ec3bf13d7473f28fbcb May 26 13:56:03.315578 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesNegativeTest-258947951-project May 26 13:56:03.315578 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: May 26 13:56:03.315578 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Volume tempest-invalid-1758260635 could not be found. May 26 13:56:03.315578 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'id': 'tempest-invalid-1758260635'} May 26 13:56:03.315578 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:56:03.316491 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:56:03.316491 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 13:56:03.316491 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 13:56:03.316491 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 13:56:03.316491 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 13:56:03.316491 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 13:56:03.316491 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 13:56:03.316491 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 13:56:03.316491 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 13:56:03.316491 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 13:56:03.316491 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 13:56:03.316491 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 13:56:03.316491 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 13:56:03.316491 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 13:56:03.316491 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 13:56:03.316491 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1758260635 could not be found. (HTTP 404) (Request-ID: req-948d4342-422a-4758-b39f-de05f97e03e6) May 26 13:56:03.316491 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:56:03.316491 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:56:03.316491 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:56:03.318315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:56:03.318315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 13:56:03.318315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 13:56:03.318315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 13:56:03.318315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 13:56:03.318315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 13:56:03.318315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 13:56:03.318315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 13:56:03.318315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 13:56:03.318315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 13:56:03.318315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 13:56:03.318315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 13:56:03.318315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 13:56:03.318315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 13:56:03.318315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 13:56:03.318315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 13:56:03.318315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 13:56:03.318315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 13:56:03.318315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 13:56:03.319425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 13:56:03.319425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 13:56:03.319425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 13:56:03.319425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 13:56:03.319425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1758260635 could not be found. May 26 13:56:03.319425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:56:03.319425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:56:03.319425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:56:03.319425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:56:03.319425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:56:03.319425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:56:03.319425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:56:03.319425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:56:03.319425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 13:56:03.319425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 13:56:03.319425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:56:03.319425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:56:03.319425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 13:56:03.319425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:56:03.319425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1758260635 could not be found. May 26 13:56:03.321852 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:56:03.321852 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:56:03.321852 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:56:03.321852 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:56:03.321852 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:56:03.321852 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:56:03.321852 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:56:03.321852 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:56:03.321852 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1758260635 could not be found. May 26 13:56:03.321852 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:56:03.321852 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9f45fb81-305b-4492-9d65-3cf23879f05b tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] Returning 404 to user: Volume tempest-invalid-1758260635 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:56:03.321852 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9f45fb81-305b-4492-9d65-3cf23879f05b tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1758260635" status: 404 len: 99 microversion: 2.1 time: 1.691575 May 26 13:56:03.325825 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5ab3934b-1fa0-4864-af8f-ac6a15be383c tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003770 May 26 13:56:03.330417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 3/4] 10.222.0.91 () {58 vars in 1139 bytes} [Thu May 26 13:56:03 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 13:56:03.331179 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 2/5] 10.222.0.91 () {58 vars in 1217 bytes} [Thu May 26 13:56:01 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1758260635 => generated 99 bytes in 1707 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 26 13:56:03.336614 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-569a0ca6-afe8-47a9-8a82-79c4aaf9b5ca tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003885 May 26 13:56:03.345601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 4/6] 10.222.0.91 () {58 vars in 1136 bytes} [Thu May 26 13:56:03 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 26 13:56:03.349457 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b27a66e7-fcdd-4f36-b154-e77551177295 tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] Calling method '.version_select at 0x7f25a68815e0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:03.548103 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-b27a66e7-fcdd-4f36-b154-e77551177295 tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] HTTP exception thrown: Volume b4e0ae55-ce15-42a5-826a-4e99c95e029e could not be found. May 26 13:56:03.559343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b27a66e7-fcdd-4f36-b154-e77551177295 tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] Request method failure captured: May 26 13:56:03.559343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: DELETE /compute/v2.1/os-volumes/b4e0ae55-ce15-42a5-826a-4e99c95e029e HTTP/1.1 May 26 13:56:03.559343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 13:56:03.559343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 13:56:03.559343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 13:56:03.559343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 13:56:03.559343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 13:56:03.559343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 13:56:03.559343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 13:56:03.559343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 13:56:03.559343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4bvkURIjNVageBrJ1XKzKZQtpa7YB7t3wC7xfoVHF71RAWYlhYEdsZsb1ap7yTZTTlEi1yn7RVLq-X96henRZVjX-DpV-OaJVD1fCptgnTTPLFHVJrA9y2He014n5oMMO2sWMtKjw_PlN7twsbIizCunhtC1-6FIsM_be69tJ5Y1b8 May 26 13:56:03.559343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 13:56:03.559343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 13:56:03.559343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 13:56:03.559343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 13:56:03.559343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 13:56:03.559343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 13:56:03.559343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: 67bf852b45d8419aad80b70b02e2bf29 May 26 13:56:03.559343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesNegativeTest-258947951 May 26 13:56:03.559343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 13:56:03.559343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 13:56:03.560766 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/67bf852b45d8419aad80b70b02e2bf29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/67bf852b45d8419aad80b70b02e2bf29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/67bf852b45d8419aad80b70b02e2bf29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_67bf852b45d8419aad80b70b02e2bf29", "adminURL": "http://10.222.0.91:8080"}]}] May 26 13:56:03.560766 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesNegativeTest-258947951 May 26 13:56:03.560766 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 67bf852b45d8419aad80b70b02e2bf29 May 26 13:56:03.560766 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesNegativeTest-258947951 May 26 13:56:03.560766 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesNegativeTest-258947951-project May 26 13:56:03.560766 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 13:56:03.560766 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 13:56:03.560766 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: b6e1ee20eef14ec3bf13d7473f28fbcb May 26 13:56:03.560766 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesNegativeTest-258947951-project May 26 13:56:03.560766 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: May 26 13:56:03.560766 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Volume b4e0ae55-ce15-42a5-826a-4e99c95e029e could not be found. May 26 13:56:03.560766 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'id': 'b4e0ae55-ce15-42a5-826a-4e99c95e029e'} May 26 13:56:03.560766 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:56:03.561579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:56:03.561579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 13:56:03.561579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 13:56:03.561579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 13:56:03.561579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 13:56:03.561579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 13:56:03.561579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 13:56:03.561579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 13:56:03.561579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 13:56:03.561579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 13:56:03.561579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 13:56:03.561579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 13:56:03.561579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 13:56:03.561579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 13:56:03.561579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 13:56:03.561579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b4e0ae55-ce15-42a5-826a-4e99c95e029e could not be found. (HTTP 404) (Request-ID: req-93e6db75-9248-4b9b-924a-755279b2586c) May 26 13:56:03.561579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:56:03.561579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:56:03.561579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:56:03.562803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:56:03.562803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 13:56:03.562803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 13:56:03.562803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 13:56:03.562803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 13:56:03.562803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 13:56:03.562803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 13:56:03.562803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 13:56:03.562803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 13:56:03.562803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 13:56:03.562803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 13:56:03.562803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 13:56:03.562803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 13:56:03.562803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 13:56:03.562803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 13:56:03.562803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 13:56:03.562803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 13:56:03.562803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 13:56:03.562803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 13:56:03.563871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 13:56:03.563871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 13:56:03.563871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 13:56:03.563871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 13:56:03.563871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b4e0ae55-ce15-42a5-826a-4e99c95e029e could not be found. May 26 13:56:03.563871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:56:03.563871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:56:03.563871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:56:03.563871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:56:03.563871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:56:03.563871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:56:03.563871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:56:03.563871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:56:03.563871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 13:56:03.563871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 13:56:03.563871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:56:03.563871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:56:03.563871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 13:56:03.563871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:56:03.564986 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b4e0ae55-ce15-42a5-826a-4e99c95e029e could not be found. May 26 13:56:03.564986 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:56:03.564986 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:56:03.564986 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:56:03.564986 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:56:03.564986 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:56:03.564986 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:56:03.564986 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:56:03.564986 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:56:03.564986 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b4e0ae55-ce15-42a5-826a-4e99c95e029e could not be found. May 26 13:56:03.564986 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:56:03.564986 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b27a66e7-fcdd-4f36-b154-e77551177295 tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] Returning 404 to user: Volume b4e0ae55-ce15-42a5-826a-4e99c95e029e could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:56:03.564986 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b27a66e7-fcdd-4f36-b154-e77551177295 tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/b4e0ae55-ce15-42a5-826a-4e99c95e029e" status: 404 len: 109 microversion: 2.1 time: 0.217732 May 26 13:56:03.572639 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 3/7] 10.222.0.91 () {58 vars in 1247 bytes} [Thu May 26 13:56:03 2022] DELETE /compute/v2.1/os-volumes/b4e0ae55-ce15-42a5-826a-4e99c95e029e => generated 109 bytes in 229 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:56:03.576284 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7eb615bd-c1fd-4ac2-83a1-0430f9c80493 tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] Calling method '.version_select at 0x7f25a6aadee0>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:04.144592 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-7eb615bd-c1fd-4ac2-83a1-0430f9c80493 tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] HTTP exception thrown: Volume 261de5ab-2c3e-4195-a998-a06568dd3bd5 could not be found. May 26 13:56:04.151224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7eb615bd-c1fd-4ac2-83a1-0430f9c80493 tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] Request method failure captured: May 26 13:56:04.151224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/os-volumes/261de5ab-2c3e-4195-a998-a06568dd3bd5 HTTP/1.1 May 26 13:56:04.151224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 13:56:04.151224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 13:56:04.151224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 13:56:04.151224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 13:56:04.151224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 13:56:04.151224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 13:56:04.151224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 13:56:04.151224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 13:56:04.151224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4bvkURIjNVageBrJ1XKzKZQtpa7YB7t3wC7xfoVHF71RAWYlhYEdsZsb1ap7yTZTTlEi1yn7RVLq-X96henRZVjX-DpV-OaJVD1fCptgnTTPLFHVJrA9y2He014n5oMMO2sWMtKjw_PlN7twsbIizCunhtC1-6FIsM_be69tJ5Y1b8 May 26 13:56:04.151224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 13:56:04.151224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 13:56:04.151224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 13:56:04.151224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 13:56:04.151224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 13:56:04.151224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 13:56:04.151224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: 67bf852b45d8419aad80b70b02e2bf29 May 26 13:56:04.151224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-VolumesNegativeTest-258947951 May 26 13:56:04.151224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 13:56:04.151224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 13:56:04.152765 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/67bf852b45d8419aad80b70b02e2bf29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/67bf852b45d8419aad80b70b02e2bf29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/67bf852b45d8419aad80b70b02e2bf29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_67bf852b45d8419aad80b70b02e2bf29", "adminURL": "http://10.222.0.91:8080"}]}] May 26 13:56:04.152765 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-VolumesNegativeTest-258947951 May 26 13:56:04.152765 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 67bf852b45d8419aad80b70b02e2bf29 May 26 13:56:04.152765 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-VolumesNegativeTest-258947951 May 26 13:56:04.152765 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-VolumesNegativeTest-258947951-project May 26 13:56:04.152765 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 13:56:04.152765 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 13:56:04.152765 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: b6e1ee20eef14ec3bf13d7473f28fbcb May 26 13:56:04.152765 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-VolumesNegativeTest-258947951-project May 26 13:56:04.152765 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: May 26 13:56:04.152765 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Volume 261de5ab-2c3e-4195-a998-a06568dd3bd5 could not be found. May 26 13:56:04.152765 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': '261de5ab-2c3e-4195-a998-a06568dd3bd5'} May 26 13:56:04.152765 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:56:04.154170 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:56:04.154170 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 13:56:04.154170 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 13:56:04.154170 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 13:56:04.154170 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 13:56:04.154170 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 13:56:04.154170 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 13:56:04.154170 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 13:56:04.154170 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 13:56:04.154170 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 13:56:04.154170 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 13:56:04.154170 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 13:56:04.154170 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 13:56:04.154170 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 13:56:04.154170 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 13:56:04.154170 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 261de5ab-2c3e-4195-a998-a06568dd3bd5 could not be found. (HTTP 404) (Request-ID: req-43b0897e-2134-4cd9-b9bc-0436909f9e8d) May 26 13:56:04.154170 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:56:04.154170 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:56:04.154170 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:56:04.155540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:56:04.155540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 13:56:04.155540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 13:56:04.155540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 13:56:04.155540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 13:56:04.155540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 13:56:04.155540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 13:56:04.155540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 13:56:04.155540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 13:56:04.155540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 13:56:04.155540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 13:56:04.155540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 13:56:04.155540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 13:56:04.155540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 13:56:04.155540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 13:56:04.155540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 13:56:04.155540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 13:56:04.155540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 13:56:04.155540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 13:56:04.156908 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 13:56:04.156908 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 13:56:04.156908 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 13:56:04.156908 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 13:56:04.156908 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 261de5ab-2c3e-4195-a998-a06568dd3bd5 could not be found. May 26 13:56:04.156908 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:56:04.156908 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:56:04.156908 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:56:04.156908 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:56:04.156908 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:56:04.156908 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:56:04.156908 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:56:04.156908 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:56:04.156908 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 13:56:04.156908 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 13:56:04.156908 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:56:04.156908 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:56:04.156908 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 13:56:04.156908 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:56:04.158333 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 261de5ab-2c3e-4195-a998-a06568dd3bd5 could not be found. May 26 13:56:04.158333 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:56:04.158333 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:56:04.158333 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:56:04.158333 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:56:04.158333 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:56:04.158333 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:56:04.158333 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:56:04.158333 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:56:04.158333 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 261de5ab-2c3e-4195-a998-a06568dd3bd5 could not be found. May 26 13:56:04.158333 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:56:04.163423 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7eb615bd-c1fd-4ac2-83a1-0430f9c80493 tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] Returning 404 to user: Volume 261de5ab-2c3e-4195-a998-a06568dd3bd5 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:56:04.163423 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7eb615bd-c1fd-4ac2-83a1-0430f9c80493 tempest-VolumesNegativeTest-258947951 tempest-VolumesNegativeTest-258947951-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/261de5ab-2c3e-4195-a998-a06568dd3bd5" status: 404 len: 109 microversion: 2.1 time: 0.589865 May 26 13:56:04.163847 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 5/8] 10.222.0.91 () {58 vars in 1244 bytes} [Thu May 26 13:56:03 2022] GET /compute/v2.1/os-volumes/261de5ab-2c3e-4195-a998-a06568dd3bd5 => generated 109 bytes in 592 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:56:04.599720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7bb6f1fa-d2a8-4e7d-bbb2-83ead10ef750 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1134088948", "imageRef": "bcaacfae-fe2c-455f-a6e1-b08361c6fa8c", "flavorRef": "452", "networks": [{"uuid": "25f232ca-c251-4c00-a04c-4af0a5376fd0"}]}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:04.846908 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-7bb6f1fa-d2a8-4e7d-bbb2-83ead10ef750 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] validate_networks() for [('25f232ca-c251-4c00-a04c-4af0a5376fd0', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:56:05.673450 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5be0af92-3620-4426-b4f7-1bd487e25306 tempest-VolumesTestJSON-1832540064 tempest-VolumesTestJSON-1832540064-project] Calling method '.version_select at 0x7f25a6999f70>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:05.790462 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5be0af92-3620-4426-b4f7-1bd487e25306 tempest-VolumesTestJSON-1832540064 tempest-VolumesTestJSON-1832540064-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/f649552c-9ae5-403a-a1f8-36e72796f398" status: 200 len: 350 microversion: 2.1 time: 0.123078 May 26 13:56:05.798990 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 6/9] 10.222.0.91 () {58 vars in 1244 bytes} [Thu May 26 13:56:05 2022] GET /compute/v2.1/os-volumes/f649552c-9ae5-403a-a1f8-36e72796f398 => generated 350 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:56:06.820775 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-7bb6f1fa-d2a8-4e7d-bbb2-83ead10ef750 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:56:06.821978 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-7bb6f1fa-d2a8-4e7d-bbb2-83ead10ef750 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:56:06.822739 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-7bb6f1fa-d2a8-4e7d-bbb2-83ead10ef750 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:56:06.823469 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-7bb6f1fa-d2a8-4e7d-bbb2-83ead10ef750 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:56:06.825351 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-7bb6f1fa-d2a8-4e7d-bbb2-83ead10ef750 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:56:06.847272 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7bb6f1fa-d2a8-4e7d-bbb2-83ead10ef750 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:06.848283 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7bb6f1fa-d2a8-4e7d-bbb2-83ead10ef750 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:06.849314 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7bb6f1fa-d2a8-4e7d-bbb2-83ead10ef750 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:06.850561 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7bb6f1fa-d2a8-4e7d-bbb2-83ead10ef750 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:06.925681 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-7bb6f1fa-d2a8-4e7d-bbb2-83ead10ef750 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Getting quotas for project 9ed49180e7f24cb296141d06576ead81. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:56:06.934467 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-7bb6f1fa-d2a8-4e7d-bbb2-83ead10ef750 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Getting quotas for user bda029aace2c4e40bcc470138243d0da and project 9ed49180e7f24cb296141d06576ead81. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:56:06.954659 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7bb6f1fa-d2a8-4e7d-bbb2-83ead10ef750 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:56:06.958110 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7bb6f1fa-d2a8-4e7d-bbb2-83ead10ef750 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bcaacfae-fe2c-455f-a6e1-b08361c6fa8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:56:07.080101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7bb6f1fa-d2a8-4e7d-bbb2-83ead10ef750 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.584862 May 26 13:56:07.086012 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 4/10] 10.222.0.91 () {60 vars in 1146 bytes} [Thu May 26 13:56:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:56:07.091449 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-43171f3d-4b31-4430-ae9b-b65bb7911e6b tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:07.092877 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-43171f3d-4b31-4430-ae9b-b65bb7911e6b tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:07.529192 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-421801b1-9339-4404-8f5c-764dec211466 tempest-VolumesTestJSON-1832540064 tempest-VolumesTestJSON-1832540064-project] Calling method '.version_select at 0x7f25a5f81c10>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:07.663544 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-421801b1-9339-4404-8f5c-764dec211466 tempest-VolumesTestJSON-1832540064 tempest-VolumesTestJSON-1832540064-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/c6ce6a7e-ad34-4371-8224-566c66a65b96" status: 200 len: 350 microversion: 2.1 time: 0.138633 May 26 13:56:07.677268 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 5/11] 10.222.0.91 () {58 vars in 1244 bytes} [Thu May 26 13:56:07 2022] GET /compute/v2.1/os-volumes/c6ce6a7e-ad34-4371-8224-566c66a65b96 => generated 350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:56:07.774691 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-43171f3d-4b31-4430-ae9b-b65bb7911e6b tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:07.791965 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-43171f3d-4b31-4430-ae9b-b65bb7911e6b tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1215 microversion: 2.1 time: 0.704546 May 26 13:56:07.796124 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 7/12] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:07 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1215 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:08.811444 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-58cbf0ab-ef0d-4f59-b037-eb3537cb5244 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:08.813325 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-58cbf0ab-ef0d-4f59-b037-eb3537cb5244 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:09.031062 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-58cbf0ab-ef0d-4f59-b037-eb3537cb5244 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:09.103026 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-58cbf0ab-ef0d-4f59-b037-eb3537cb5244 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1215 microversion: 2.1 time: 0.295352 May 26 13:56:09.107606 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 6/13] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:08 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1215 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:09.585481 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-768bc0f7-8c90-4f56-827b-8f90192d5425 tempest-VolumesTestJSON-1832540064 tempest-VolumesTestJSON-1832540064-project] Calling method '.version_select at 0x7f25a6878790>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:09.694862 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-768bc0f7-8c90-4f56-827b-8f90192d5425 tempest-VolumesTestJSON-1832540064 tempest-VolumesTestJSON-1832540064-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/302d0985-47b0-447d-b75a-cb5361b4ff31" status: 200 len: 351 microversion: 2.1 time: 0.114700 May 26 13:56:09.697348 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 8/14] 10.222.0.91 () {58 vars in 1244 bytes} [Thu May 26 13:56:09 2022] GET /compute/v2.1/os-volumes/302d0985-47b0-447d-b75a-cb5361b4ff31 => generated 351 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:56:09.707404 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dc1400f2-19fc-4ce8-9e3d-c9dc070ae2e2 tempest-VolumesTestJSON-1832540064 tempest-VolumesTestJSON-1832540064-project] Calling method '.version_select at 0x7f25a5734ee0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:09.913802 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dc1400f2-19fc-4ce8-9e3d-c9dc070ae2e2 tempest-VolumesTestJSON-1832540064 tempest-VolumesTestJSON-1832540064-project] 10.222.0.91 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.210519 May 26 13:56:09.914407 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 7/15] 10.222.0.91 () {58 vars in 1133 bytes} [Thu May 26 13:56:09 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:56:09.927050 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-94c61404-a581-4d9b-9ca4-6ec9b530808c tempest-VolumesTestJSON-1832540064 tempest-VolumesTestJSON-1832540064-project] Calling method '.version_select at 0x7f25a684fdc0>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:10.080810 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-94c61404-a581-4d9b-9ca4-6ec9b530808c tempest-VolumesTestJSON-1832540064 tempest-VolumesTestJSON-1832540064-project] 10.222.0.91 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.156982 May 26 13:56:10.081048 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 9/16] 10.222.0.91 () {58 vars in 1148 bytes} [Thu May 26 13:56:09 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:56:10.097488 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b037ee19-5725-4203-91dd-e15679d7b772 tempest-VolumesTestJSON-1832540064 tempest-VolumesTestJSON-1832540064-project] Calling method '.version_select at 0x7f25a5f9bb80>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:10.125875 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-868056b0-6b0a-436c-b265-c2d7523aac37 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:10.126594 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-868056b0-6b0a-436c-b265-c2d7523aac37 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:10.136799 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-868056b0-6b0a-436c-b265-c2d7523aac37 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:10.137421 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-868056b0-6b0a-436c-b265-c2d7523aac37 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:10.138296 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-868056b0-6b0a-436c-b265-c2d7523aac37 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:10.138991 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-868056b0-6b0a-436c-b265-c2d7523aac37 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:10.339589 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b037ee19-5725-4203-91dd-e15679d7b772 tempest-VolumesTestJSON-1832540064 tempest-VolumesTestJSON-1832540064-project] 10.222.0.91 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.250423 May 26 13:56:10.340498 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 8/17] 10.222.0.91 () {58 vars in 1133 bytes} [Thu May 26 13:56:10 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:10.353293 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dd1e1e5c-744b-4d98-87b2-1fc6a2466e4a tempest-VolumesTestJSON-1832540064 tempest-VolumesTestJSON-1832540064-project] Calling method '.version_select at 0x7f25a573d8b0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:10.586869 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-868056b0-6b0a-436c-b265-c2d7523aac37 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:10.616750 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-868056b0-6b0a-436c-b265-c2d7523aac37 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1219 microversion: 2.1 time: 0.495422 May 26 13:56:10.619051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 10/18] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:10 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1219 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:10.638054 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dd1e1e5c-744b-4d98-87b2-1fc6a2466e4a tempest-VolumesTestJSON-1832540064 tempest-VolumesTestJSON-1832540064-project] 10.222.0.91 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.288308 May 26 13:56:10.638570 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 9/19] 10.222.0.91 () {58 vars in 1166 bytes} [Thu May 26 13:56:10 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:56:10.652133 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-79dd1394-b4dc-4bc8-920d-de788c5d3464 tempest-VolumesTestJSON-1832540064 tempest-VolumesTestJSON-1832540064-project] Calling method '.version_select at 0x7f25a67d34c0>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:10.785812 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-79dd1394-b4dc-4bc8-920d-de788c5d3464 tempest-VolumesTestJSON-1832540064 tempest-VolumesTestJSON-1832540064-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.138128 May 26 13:56:10.787023 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 11/20] 10.222.0.91 () {58 vars in 1169 bytes} [Thu May 26 13:56:10 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:56:10.807898 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0300564b-d0c8-4255-bc56-669b6e087439 tempest-VolumesTestJSON-1832540064 tempest-VolumesTestJSON-1832540064-project] Calling method '.version_select at 0x7f25a574f550>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:11.008205 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0300564b-d0c8-4255-bc56-669b6e087439 tempest-VolumesTestJSON-1832540064 tempest-VolumesTestJSON-1832540064-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.212027 May 26 13:56:11.009110 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 10/21] 10.222.0.91 () {58 vars in 1154 bytes} [Thu May 26 13:56:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:11.021586 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-dc6c003d-2c52-4538-9c25-a561b5398d0a tempest-VolumesTestJSON-1832540064 tempest-VolumesTestJSON-1832540064-project] Calling method '.version_select at 0x7f25a67dd4c0>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:11.209607 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-dc6c003d-2c52-4538-9c25-a561b5398d0a tempest-VolumesTestJSON-1832540064 tempest-VolumesTestJSON-1832540064-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.191748 May 26 13:56:11.210510 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 12/22] 10.222.0.91 () {58 vars in 1187 bytes} [Thu May 26 13:56:11 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:56:11.222373 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f20fd5fd-a732-4807-9ba4-e74552081469 tempest-VolumesTestJSON-1832540064 tempest-VolumesTestJSON-1832540064-project] Calling method '.version_select at 0x7f25a573d940>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:11.400457 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f20fd5fd-a732-4807-9ba4-e74552081469 tempest-VolumesTestJSON-1832540064 tempest-VolumesTestJSON-1832540064-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.182046 May 26 13:56:11.401112 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 11/23] 10.222.0.91 () {58 vars in 1154 bytes} [Thu May 26 13:56:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:11.635369 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a6e57885-4c2f-4a14-a393-f714bc475b71 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:11.635998 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a6e57885-4c2f-4a14-a393-f714bc475b71 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:11.647338 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a6e57885-4c2f-4a14-a393-f714bc475b71 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:11.647793 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a6e57885-4c2f-4a14-a393-f714bc475b71 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:11.651679 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a6e57885-4c2f-4a14-a393-f714bc475b71 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:11.660993 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a6e57885-4c2f-4a14-a393-f714bc475b71 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:11.779890 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a6e57885-4c2f-4a14-a393-f714bc475b71 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:11.789443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a6e57885-4c2f-4a14-a393-f714bc475b71 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1219 microversion: 2.1 time: 0.156333 May 26 13:56:11.790035 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 13/24] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:11 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1219 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:12.045596 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1783f810-7012-4974-bf06-f78222a1f6ec tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Action: 'create', calling method: .version_select at 0x7f25a5f9bdc0>, body: {"keypair": {"name": "tempest-keypair-1648317980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuOoKL78LTwmaGxOUIJNMlEJMkNaONNCVKzus1oCjIh2KZmfhBvYdsjW8pYKamTCqGnK7TswIj9B4DlzvnpZ/Oa3+OFDn6tshkZ2SsxCSJfI1gvMbJHqi04HlUEBHyONg=="}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:12.091244 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-1783f810-7012-4974-bf06-f78222a1f6ec tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Getting quotas for project 7116b23d173c4192a6c8d996ad31d57c. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:56:12.102604 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-1783f810-7012-4974-bf06-f78222a1f6ec tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Getting quotas for user c67205b7150c460a81ff545d5ba29cad and project 7116b23d173c4192a6c8d996ad31d57c. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:56:12.190977 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1783f810-7012-4974-bf06-f78222a1f6ec tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.387767 May 26 13:56:12.192133 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 12/25] 10.222.0.91 () {62 vars in 1199 bytes} [Thu May 26 13:56:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 391 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 13:56:12.807381 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c22e26bb-16da-4d2d-af93-5e67f9ea78ea tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:12.808580 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c22e26bb-16da-4d2d-af93-5e67f9ea78ea tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:12.819328 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c22e26bb-16da-4d2d-af93-5e67f9ea78ea tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:12.827229 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c22e26bb-16da-4d2d-af93-5e67f9ea78ea tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:12.830126 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c22e26bb-16da-4d2d-af93-5e67f9ea78ea tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:12.831590 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c22e26bb-16da-4d2d-af93-5e67f9ea78ea tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:13.001245 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c22e26bb-16da-4d2d-af93-5e67f9ea78ea tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:13.013876 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c22e26bb-16da-4d2d-af93-5e67f9ea78ea tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1219 microversion: 2.1 time: 0.208889 May 26 13:56:13.016282 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 14/26] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:12 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1219 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:14.032352 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f6303d27-41ea-4094-b1d6-36422010428e tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:14.033638 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f6303d27-41ea-4094-b1d6-36422010428e tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:14.047577 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f6303d27-41ea-4094-b1d6-36422010428e tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:14.048297 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f6303d27-41ea-4094-b1d6-36422010428e tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:14.051437 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f6303d27-41ea-4094-b1d6-36422010428e tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:14.051910 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f6303d27-41ea-4094-b1d6-36422010428e tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:14.405770 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f6303d27-41ea-4094-b1d6-36422010428e tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:14.433190 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f6303d27-41ea-4094-b1d6-36422010428e tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1211 microversion: 2.1 time: 0.405512 May 26 13:56:14.435014 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 13/27] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:14 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1211 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:15.166467 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-96969975-9e8d-4f45-af8d-db4f2a7de73d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1180602366", "imageRef": "bcaacfae-fe2c-455f-a6e1-b08361c6fa8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:15.360330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-96969975-9e8d-4f45-af8d-db4f2a7de73d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] validate_networks() for [('94664734-1654-43f2-b262-23850dca9bb9', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:56:15.459146 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d41a10f8-c87d-4aac-b979-2cb9fe864bd2 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:15.466738 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d41a10f8-c87d-4aac-b979-2cb9fe864bd2 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:15.491632 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d41a10f8-c87d-4aac-b979-2cb9fe864bd2 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:15.494024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d41a10f8-c87d-4aac-b979-2cb9fe864bd2 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:15.496431 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d41a10f8-c87d-4aac-b979-2cb9fe864bd2 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:15.497362 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d41a10f8-c87d-4aac-b979-2cb9fe864bd2 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:15.739790 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d41a10f8-c87d-4aac-b979-2cb9fe864bd2 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:15.748782 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d41a10f8-c87d-4aac-b979-2cb9fe864bd2 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1211 microversion: 2.1 time: 0.299219 May 26 13:56:15.761300 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 14/28] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:15 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1211 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:16.414554 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-703f36c8-1d37-4f9d-ad61-d1afb20823cd tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Action: 'create', calling method: .version_select at 0x7f25a4ede670>, body: {"keypair": {"name": "tempest-keypair-2112284842", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqVVAsXZgjyLgXPfwgztp0OAtoG4d03EHFX7LccNuhFWo+NcfyghZ8VoyLy6GfgBufePdpPxHTzx1ZawCWZoEDwgzr3qnEERStWbRsIUEcPB5SiAv0v9SB/ql7cuzDD0A=="}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:16.472764 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-703f36c8-1d37-4f9d-ad61-d1afb20823cd tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Getting quotas for project af9d168c40ea4df99b495eb06245d066. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:56:16.478223 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-703f36c8-1d37-4f9d-ad61-d1afb20823cd tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Getting quotas for user 592975b43454407abde6c7cab2504982 and project af9d168c40ea4df99b495eb06245d066. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:56:16.520277 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-703f36c8-1d37-4f9d-ad61-d1afb20823cd tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.422475 May 26 13:56:16.524127 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 15/29] 10.222.0.91 () {60 vars in 1158 bytes} [Thu May 26 13:56:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:56:16.766738 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-42ed4966-b6b4-4ab6-9332-cbfbff36278d tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:16.767466 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-42ed4966-b6b4-4ab6-9332-cbfbff36278d tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:16.781895 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-42ed4966-b6b4-4ab6-9332-cbfbff36278d tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:16.782407 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-42ed4966-b6b4-4ab6-9332-cbfbff36278d tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:16.787095 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-42ed4966-b6b4-4ab6-9332-cbfbff36278d tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:16.790347 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-42ed4966-b6b4-4ab6-9332-cbfbff36278d tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:16.919365 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:17.162563 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-42ed4966-b6b4-4ab6-9332-cbfbff36278d tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:17.185745 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-42ed4966-b6b4-4ab6-9332-cbfbff36278d tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1275 microversion: 2.1 time: 0.422486 May 26 13:56:17.200615 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 16/30] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:16 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1275 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:17.791748 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:18.030430 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-96969975-9e8d-4f45-af8d-db4f2a7de73d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:56:18.030853 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-96969975-9e8d-4f45-af8d-db4f2a7de73d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:56:18.031559 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-96969975-9e8d-4f45-af8d-db4f2a7de73d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:56:18.031755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-96969975-9e8d-4f45-af8d-db4f2a7de73d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:56:18.032161 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-96969975-9e8d-4f45-af8d-db4f2a7de73d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:56:18.069142 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-96969975-9e8d-4f45-af8d-db4f2a7de73d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:18.069142 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-96969975-9e8d-4f45-af8d-db4f2a7de73d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:18.069904 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-96969975-9e8d-4f45-af8d-db4f2a7de73d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:18.070336 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-96969975-9e8d-4f45-af8d-db4f2a7de73d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:18.181946 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-96969975-9e8d-4f45-af8d-db4f2a7de73d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Getting quotas for project e3d27b9eb0ef4c338c18c2a1d02db444. Resources: {'ram', 'cores', 'instances'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:56:18.206978 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-96969975-9e8d-4f45-af8d-db4f2a7de73d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Getting quotas for user 8d7bcc48c8d844e5b36b1c4e2748e766 and project e3d27b9eb0ef4c338c18c2a1d02db444. Resources: {'ram', 'cores', 'instances'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:56:18.208086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0517b155-2c42-42f8-9fd7-6b9e4c19caba tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:18.212801 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0517b155-2c42-42f8-9fd7-6b9e4c19caba tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:18.231727 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0517b155-2c42-42f8-9fd7-6b9e4c19caba tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:18.236172 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0517b155-2c42-42f8-9fd7-6b9e4c19caba tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:18.240626 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0517b155-2c42-42f8-9fd7-6b9e4c19caba tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:18.242293 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0517b155-2c42-42f8-9fd7-6b9e4c19caba tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:18.253503 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-96969975-9e8d-4f45-af8d-db4f2a7de73d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:56:18.255941 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-96969975-9e8d-4f45-af8d-db4f2a7de73d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bcaacfae-fe2c-455f-a6e1-b08361c6fa8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:56:18.448502 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-96969975-9e8d-4f45-af8d-db4f2a7de73d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.734246 May 26 13:56:18.449950 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 15/31] 10.222.0.91 () {60 vars in 1146 bytes} [Thu May 26 13:56:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 3736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:56:18.475338 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7fe40184-ab82-4eb0-b95c-1bdec5fdd812 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:18.482442 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7fe40184-ab82-4eb0-b95c-1bdec5fdd812 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:18.691942 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7fe40184-ab82-4eb0-b95c-1bdec5fdd812 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:18.722485 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7fe40184-ab82-4eb0-b95c-1bdec5fdd812 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1222 microversion: 2.1 time: 0.239879 May 26 13:56:18.741311 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 16/32] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:18 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1222 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:18.743842 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0517b155-2c42-42f8-9fd7-6b9e4c19caba tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:18.763978 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0517b155-2c42-42f8-9fd7-6b9e4c19caba tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1273 microversion: 2.1 time: 0.561289 May 26 13:56:18.769244 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 17/33] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:18 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1273 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:19.057084 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-bc887e32-1a27-4250-95f0-7ee7343b0476 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1714916706", "imageRef": "bcaacfae-fe2c-455f-a6e1-b08361c6fa8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:19.233561 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-bc887e32-1a27-4250-95f0-7ee7343b0476 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] validate_networks() for [('94664734-1654-43f2-b262-23850dca9bb9', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:56:19.788702 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2c739e80-fc44-43e1-917f-3f0de1dd80c3 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:19.790099 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2c739e80-fc44-43e1-917f-3f0de1dd80c3 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:19.820102 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2c739e80-fc44-43e1-917f-3f0de1dd80c3 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:19.820994 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2c739e80-fc44-43e1-917f-3f0de1dd80c3 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:19.822054 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2c739e80-fc44-43e1-917f-3f0de1dd80c3 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:19.823811 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2c739e80-fc44-43e1-917f-3f0de1dd80c3 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:20.190869 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2c739e80-fc44-43e1-917f-3f0de1dd80c3 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:20.269100 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2c739e80-fc44-43e1-917f-3f0de1dd80c3 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1273 microversion: 2.1 time: 0.482979 May 26 13:56:20.281617 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 18/34] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:19 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1273 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:56:20.310192 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c62193c0-006e-4d79-9be6-601763a7797d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1813275637", "imageRef": "bcaacfae-fe2c-455f-a6e1-b08361c6fa8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b5ae806-b190-4516-8465-70dba440ef62"}], "security_groups": [{"name": "tempest-securitygroup--390808429"}], "key_name": "tempest-keypair-1648317980", "user_data": "}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:20.941758 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-c62193c0-006e-4d79-9be6-601763a7797d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] validate_networks() for [('8b5ae806-b190-4516-8465-70dba440ef62', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:56:21.067273 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-bc887e32-1a27-4250-95f0-7ee7343b0476 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:56:21.067946 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-bc887e32-1a27-4250-95f0-7ee7343b0476 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:56:21.068159 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-bc887e32-1a27-4250-95f0-7ee7343b0476 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:56:21.068568 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-bc887e32-1a27-4250-95f0-7ee7343b0476 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:56:21.068997 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-bc887e32-1a27-4250-95f0-7ee7343b0476 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:56:21.104710 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bc887e32-1a27-4250-95f0-7ee7343b0476 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:21.106525 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bc887e32-1a27-4250-95f0-7ee7343b0476 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:21.110833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bc887e32-1a27-4250-95f0-7ee7343b0476 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:21.117497 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bc887e32-1a27-4250-95f0-7ee7343b0476 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:21.179338 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-bc887e32-1a27-4250-95f0-7ee7343b0476 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Getting quotas for project e3d27b9eb0ef4c338c18c2a1d02db444. Resources: {'ram', 'cores', 'instances'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:56:21.198711 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-bc887e32-1a27-4250-95f0-7ee7343b0476 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Getting quotas for user 8d7bcc48c8d844e5b36b1c4e2748e766 and project e3d27b9eb0ef4c338c18c2a1d02db444. Resources: {'ram', 'cores', 'instances'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:56:21.254637 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-bc887e32-1a27-4250-95f0-7ee7343b0476 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:56:21.258163 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-bc887e32-1a27-4250-95f0-7ee7343b0476 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bcaacfae-fe2c-455f-a6e1-b08361c6fa8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:56:21.331063 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-bc887e32-1a27-4250-95f0-7ee7343b0476 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.296186 May 26 13:56:21.334274 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 17/35] 10.222.0.91 () {60 vars in 1146 bytes} [Thu May 26 13:56:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 2301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:56:21.349405 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a1c37e39-2e1d-4819-8499-d62d1c865a6f tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:21.350661 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a1c37e39-2e1d-4819-8499-d62d1c865a6f tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:21.364059 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a1c37e39-2e1d-4819-8499-d62d1c865a6f tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:21.364758 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a1c37e39-2e1d-4819-8499-d62d1c865a6f tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:21.377408 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a1c37e39-2e1d-4819-8499-d62d1c865a6f tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:21.378221 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a1c37e39-2e1d-4819-8499-d62d1c865a6f tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:22.140870 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a1c37e39-2e1d-4819-8499-d62d1c865a6f tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:22.158474 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a1c37e39-2e1d-4819-8499-d62d1c865a6f tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.822877 May 26 13:56:22.159399 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 18/36] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:21 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:22.167456 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2fa595a4-7ecf-4eee-942e-7d235e69bc44 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:22.175496 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2fa595a4-7ecf-4eee-942e-7d235e69bc44 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:22.189174 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2fa595a4-7ecf-4eee-942e-7d235e69bc44 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:22.189862 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2fa595a4-7ecf-4eee-942e-7d235e69bc44 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:22.190947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2fa595a4-7ecf-4eee-942e-7d235e69bc44 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:22.191525 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2fa595a4-7ecf-4eee-942e-7d235e69bc44 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:22.319315 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2fa595a4-7ecf-4eee-942e-7d235e69bc44 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:22.330702 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2fa595a4-7ecf-4eee-942e-7d235e69bc44 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1226 microversion: 2.1 time: 0.170134 May 26 13:56:22.334122 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 19/37] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:22 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1226 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:22.390035 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-c62193c0-006e-4d79-9be6-601763a7797d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:56:22.391148 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-c62193c0-006e-4d79-9be6-601763a7797d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:56:22.391441 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-c62193c0-006e-4d79-9be6-601763a7797d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:56:22.392305 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-c62193c0-006e-4d79-9be6-601763a7797d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:56:22.392719 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-c62193c0-006e-4d79-9be6-601763a7797d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:56:22.417627 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c62193c0-006e-4d79-9be6-601763a7797d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:22.418082 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c62193c0-006e-4d79-9be6-601763a7797d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:22.419136 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c62193c0-006e-4d79-9be6-601763a7797d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:22.419584 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c62193c0-006e-4d79-9be6-601763a7797d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:22.468357 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-c62193c0-006e-4d79-9be6-601763a7797d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Getting quotas for project 7116b23d173c4192a6c8d996ad31d57c. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:56:22.489909 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-c62193c0-006e-4d79-9be6-601763a7797d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Getting quotas for user c67205b7150c460a81ff545d5ba29cad and project 7116b23d173c4192a6c8d996ad31d57c. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:56:22.507900 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c62193c0-006e-4d79-9be6-601763a7797d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:56:22.510504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c62193c0-006e-4d79-9be6-601763a7797d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bcaacfae-fe2c-455f-a6e1-b08361c6fa8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:56:22.605523 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c62193c0-006e-4d79-9be6-601763a7797d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.318742 May 26 13:56:22.611638 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 19/38] 10.222.0.91 () {62 vars in 1187 bytes} [Thu May 26 13:56:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 2325 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 13:56:22.616746 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5966693a-c24a-4258-a957-aacb5c62e68b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:22.617432 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5966693a-c24a-4258-a957-aacb5c62e68b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:22.775746 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5966693a-c24a-4258-a957-aacb5c62e68b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:22.792473 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5966693a-c24a-4258-a957-aacb5c62e68b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:22.794211 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5966693a-c24a-4258-a957-aacb5c62e68b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:22.799672 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5966693a-c24a-4258-a957-aacb5c62e68b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1282 microversion: 2.20 time: 0.186655 May 26 13:56:22.804536 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 20/39] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:22 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1282 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:56:22.941720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3c43401b-84ef-414c-9ff9-a66018b51890 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-978305612", "imageRef": "bcaacfae-fe2c-455f-a6e1-b08361c6fa8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f7e5c2e-dcd0-44c0-a251-a7bcffefb292"}], "security_groups": [{"name": "tempest-securitygroup--1538021610"}], "key_name": "tempest-keypair-2112284842", "user_data": "}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:23.163701 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-3c43401b-84ef-414c-9ff9-a66018b51890 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] validate_networks() for [('5f7e5c2e-dcd0-44c0-a251-a7bcffefb292', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:56:23.178887 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e446a37e-a4d0-4397-9f0f-f42d58ee8b19 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:23.180256 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e446a37e-a4d0-4397-9f0f-f42d58ee8b19 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:23.201659 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e446a37e-a4d0-4397-9f0f-f42d58ee8b19 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:23.203855 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e446a37e-a4d0-4397-9f0f-f42d58ee8b19 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:23.206760 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e446a37e-a4d0-4397-9f0f-f42d58ee8b19 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:23.209137 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e446a37e-a4d0-4397-9f0f-f42d58ee8b19 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:23.574131 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e446a37e-a4d0-4397-9f0f-f42d58ee8b19 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:23.589382 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e446a37e-a4d0-4397-9f0f-f42d58ee8b19 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.413368 May 26 13:56:23.590538 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 21/40] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:23 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:23.602115 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6a76575d-c4d5-4565-b1df-be9f0295ce24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:23.602702 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6a76575d-c4d5-4565-b1df-be9f0295ce24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:23.621352 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6a76575d-c4d5-4565-b1df-be9f0295ce24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:23.622720 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6a76575d-c4d5-4565-b1df-be9f0295ce24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:23.626018 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6a76575d-c4d5-4565-b1df-be9f0295ce24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:23.626687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6a76575d-c4d5-4565-b1df-be9f0295ce24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:23.819120 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6a76575d-c4d5-4565-b1df-be9f0295ce24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:23.841534 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6a76575d-c4d5-4565-b1df-be9f0295ce24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1226 microversion: 2.1 time: 0.249796 May 26 13:56:23.842400 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 22/41] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:23 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1226 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:23.862363 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0f9dd3c1-a0ce-4a58-a1b9-5d75ff3ee503 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:23.862988 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0f9dd3c1-a0ce-4a58-a1b9-5d75ff3ee503 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:23.895265 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0f9dd3c1-a0ce-4a58-a1b9-5d75ff3ee503 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:23.895727 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0f9dd3c1-a0ce-4a58-a1b9-5d75ff3ee503 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:23.896511 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0f9dd3c1-a0ce-4a58-a1b9-5d75ff3ee503 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:23.896951 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0f9dd3c1-a0ce-4a58-a1b9-5d75ff3ee503 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:24.061839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0f9dd3c1-a0ce-4a58-a1b9-5d75ff3ee503 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:24.094733 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0f9dd3c1-a0ce-4a58-a1b9-5d75ff3ee503 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:24.104024 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0f9dd3c1-a0ce-4a58-a1b9-5d75ff3ee503 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:24.107201 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0f9dd3c1-a0ce-4a58-a1b9-5d75ff3ee503 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1286 microversion: 2.20 time: 0.251276 May 26 13:56:24.110039 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 23/42] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:23 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1286 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:56:24.556811 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-3c43401b-84ef-414c-9ff9-a66018b51890 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:56:24.562455 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-3c43401b-84ef-414c-9ff9-a66018b51890 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:56:24.567983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-3c43401b-84ef-414c-9ff9-a66018b51890 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:56:24.570311 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-3c43401b-84ef-414c-9ff9-a66018b51890 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:56:24.573845 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-3c43401b-84ef-414c-9ff9-a66018b51890 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:56:24.614077 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c43401b-84ef-414c-9ff9-a66018b51890 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:24.615297 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-30cfaaa1-5926-4fb7-a42d-b8927531f6f9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:24.615757 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c43401b-84ef-414c-9ff9-a66018b51890 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:24.616596 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-30cfaaa1-5926-4fb7-a42d-b8927531f6f9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:24.618584 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c43401b-84ef-414c-9ff9-a66018b51890 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:24.619107 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c43401b-84ef-414c-9ff9-a66018b51890 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:24.637623 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-30cfaaa1-5926-4fb7-a42d-b8927531f6f9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:24.639405 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-30cfaaa1-5926-4fb7-a42d-b8927531f6f9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:24.641989 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-30cfaaa1-5926-4fb7-a42d-b8927531f6f9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:24.644077 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-30cfaaa1-5926-4fb7-a42d-b8927531f6f9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:24.672439 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-3c43401b-84ef-414c-9ff9-a66018b51890 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Getting quotas for project af9d168c40ea4df99b495eb06245d066. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:56:24.679531 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-3c43401b-84ef-414c-9ff9-a66018b51890 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Getting quotas for user 592975b43454407abde6c7cab2504982 and project af9d168c40ea4df99b495eb06245d066. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:56:24.724022 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3c43401b-84ef-414c-9ff9-a66018b51890 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:56:24.736407 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3c43401b-84ef-414c-9ff9-a66018b51890 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bcaacfae-fe2c-455f-a6e1-b08361c6fa8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:56:24.871465 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3c43401b-84ef-414c-9ff9-a66018b51890 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.936563 May 26 13:56:24.904774 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 20/43] 10.222.0.91 () {60 vars in 1146 bytes} [Thu May 26 13:56:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 1970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:56:24.914548 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-378783ca-08a8-4964-98c5-a0368abc05c8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:24.915368 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-378783ca-08a8-4964-98c5-a0368abc05c8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:24.925611 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-378783ca-08a8-4964-98c5-a0368abc05c8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:24.926263 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-378783ca-08a8-4964-98c5-a0368abc05c8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:24.927461 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-378783ca-08a8-4964-98c5-a0368abc05c8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:24.927716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-378783ca-08a8-4964-98c5-a0368abc05c8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:25.043173 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-30cfaaa1-5926-4fb7-a42d-b8927531f6f9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:25.067474 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-30cfaaa1-5926-4fb7-a42d-b8927531f6f9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.463251 May 26 13:56:25.072438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 24/44] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:24 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:25.091770 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-20f8d540-699c-4d95-87b2-74b4ce28f8ae tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:25.097677 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-20f8d540-699c-4d95-87b2-74b4ce28f8ae tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:25.212704 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-378783ca-08a8-4964-98c5-a0368abc05c8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:25.226981 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-378783ca-08a8-4964-98c5-a0368abc05c8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1226 microversion: 2.1 time: 0.318023 May 26 13:56:25.229052 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 21/45] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:24 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1226 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:25.259271 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ac79e932-b23a-4d74-8b3f-401aad5503f3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:25.259920 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ac79e932-b23a-4d74-8b3f-401aad5503f3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:25.314064 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ac79e932-b23a-4d74-8b3f-401aad5503f3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:25.317945 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ac79e932-b23a-4d74-8b3f-401aad5503f3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:25.323338 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ac79e932-b23a-4d74-8b3f-401aad5503f3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:25.325637 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ac79e932-b23a-4d74-8b3f-401aad5503f3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:25.399011 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-20f8d540-699c-4d95-87b2-74b4ce28f8ae tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:25.410941 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-20f8d540-699c-4d95-87b2-74b4ce28f8ae tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1241 microversion: 2.1 time: 0.337018 May 26 13:56:25.430770 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 25/46] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:25 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1241 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:25.671305 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ac79e932-b23a-4d74-8b3f-401aad5503f3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:25.684333 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ac79e932-b23a-4d74-8b3f-401aad5503f3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:25.693547 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ac79e932-b23a-4d74-8b3f-401aad5503f3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:25.700560 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ac79e932-b23a-4d74-8b3f-401aad5503f3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1286 microversion: 2.20 time: 0.462884 May 26 13:56:25.705930 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 22/47] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:25 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1286 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:56:26.096296 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cf1d6977-bb72-447d-b47a-0138ae8fae11 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:26.097725 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-cf1d6977-bb72-447d-b47a-0138ae8fae11 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:26.107003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cf1d6977-bb72-447d-b47a-0138ae8fae11 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:26.107964 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cf1d6977-bb72-447d-b47a-0138ae8fae11 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:26.113200 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cf1d6977-bb72-447d-b47a-0138ae8fae11 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:26.119687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cf1d6977-bb72-447d-b47a-0138ae8fae11 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:26.246340 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-28e460d7-6512-4069-a117-1d98f9c8662a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:26.254763 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-28e460d7-6512-4069-a117-1d98f9c8662a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:26.277139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-28e460d7-6512-4069-a117-1d98f9c8662a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:26.285751 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-28e460d7-6512-4069-a117-1d98f9c8662a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:26.287377 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-28e460d7-6512-4069-a117-1d98f9c8662a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:26.290583 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-28e460d7-6512-4069-a117-1d98f9c8662a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:26.587166 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-28e460d7-6512-4069-a117-1d98f9c8662a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:26.596245 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-28e460d7-6512-4069-a117-1d98f9c8662a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1274 microversion: 2.1 time: 0.353637 May 26 13:56:26.599587 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 23/48] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:26 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1274 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:56:26.612413 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-aa032cf1-5c12-48fc-8692-42d1f6d8a271 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:26.616283 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-aa032cf1-5c12-48fc-8692-42d1f6d8a271 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:26.645745 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aa032cf1-5c12-48fc-8692-42d1f6d8a271 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:26.646960 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aa032cf1-5c12-48fc-8692-42d1f6d8a271 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:26.647793 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aa032cf1-5c12-48fc-8692-42d1f6d8a271 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:26.648235 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aa032cf1-5c12-48fc-8692-42d1f6d8a271 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:26.690511 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cf1d6977-bb72-447d-b47a-0138ae8fae11 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:26.703396 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-cf1d6977-bb72-447d-b47a-0138ae8fae11 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.618023 May 26 13:56:26.709639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 26/49] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:26 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:26.730476 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-991a8920-dacc-4431-aa92-ec37ac1f9771 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:26.731177 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-991a8920-dacc-4431-aa92-ec37ac1f9771 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:26.749034 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-991a8920-dacc-4431-aa92-ec37ac1f9771 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:26.749824 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-991a8920-dacc-4431-aa92-ec37ac1f9771 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:26.750837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-991a8920-dacc-4431-aa92-ec37ac1f9771 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:26.751834 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-991a8920-dacc-4431-aa92-ec37ac1f9771 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:26.836226 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-aa032cf1-5c12-48fc-8692-42d1f6d8a271 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:26.877906 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-aa032cf1-5c12-48fc-8692-42d1f6d8a271 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1245 microversion: 2.1 time: 0.263510 May 26 13:56:26.880336 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 24/50] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:26 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1245 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:26.948254 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-991a8920-dacc-4431-aa92-ec37ac1f9771 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:26.961406 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-991a8920-dacc-4431-aa92-ec37ac1f9771 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:26.964709 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-991a8920-dacc-4431-aa92-ec37ac1f9771 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:26.970336 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-991a8920-dacc-4431-aa92-ec37ac1f9771 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1334 microversion: 2.20 time: 0.242409 May 26 13:56:26.971684 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 27/51] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:26 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1334 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:56:27.616476 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bd9f9ded-6b5c-4d55-b1f6-7739e7bb6f8f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:27.617192 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bd9f9ded-6b5c-4d55-b1f6-7739e7bb6f8f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:27.632522 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:27.649197 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bd9f9ded-6b5c-4d55-b1f6-7739e7bb6f8f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:27.650287 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bd9f9ded-6b5c-4d55-b1f6-7739e7bb6f8f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:27.655484 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bd9f9ded-6b5c-4d55-b1f6-7739e7bb6f8f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:27.658203 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bd9f9ded-6b5c-4d55-b1f6-7739e7bb6f8f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:27.728807 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b5597241-974e-41fa-9e62-ee08589a202f tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:27.729580 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b5597241-974e-41fa-9e62-ee08589a202f tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:27.745722 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b5597241-974e-41fa-9e62-ee08589a202f tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:27.747139 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b5597241-974e-41fa-9e62-ee08589a202f tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:27.750485 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b5597241-974e-41fa-9e62-ee08589a202f tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:27.759024 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b5597241-974e-41fa-9e62-ee08589a202f tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:27.958650 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bd9f9ded-6b5c-4d55-b1f6-7739e7bb6f8f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:27.974963 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bd9f9ded-6b5c-4d55-b1f6-7739e7bb6f8f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1274 microversion: 2.1 time: 0.362771 May 26 13:56:27.985757 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 25/52] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:27 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1274 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:27.991042 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3fd7c072-b171-447b-a1e2-c3ef0fc4008d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:27.996475 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3fd7c072-b171-447b-a1e2-c3ef0fc4008d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:28.011113 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3fd7c072-b171-447b-a1e2-c3ef0fc4008d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:28.011569 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3fd7c072-b171-447b-a1e2-c3ef0fc4008d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:28.012352 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3fd7c072-b171-447b-a1e2-c3ef0fc4008d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:28.015226 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3fd7c072-b171-447b-a1e2-c3ef0fc4008d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:28.343996 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b5597241-974e-41fa-9e62-ee08589a202f tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:28.358145 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b5597241-974e-41fa-9e62-ee08589a202f tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.634000 May 26 13:56:28.363344 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 28/53] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:27 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:28.369901 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-bc2f2064-58d1-488e-9b2d-a0e91c004efe tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:28.373270 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-bc2f2064-58d1-488e-9b2d-a0e91c004efe tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:28.401893 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bc2f2064-58d1-488e-9b2d-a0e91c004efe tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:28.403472 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bc2f2064-58d1-488e-9b2d-a0e91c004efe tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:28.410047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bc2f2064-58d1-488e-9b2d-a0e91c004efe tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:28.411368 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bc2f2064-58d1-488e-9b2d-a0e91c004efe tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:28.448140 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3fd7c072-b171-447b-a1e2-c3ef0fc4008d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:28.462191 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3fd7c072-b171-447b-a1e2-c3ef0fc4008d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1245 microversion: 2.1 time: 0.475185 May 26 13:56:28.462838 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 26/54] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:27 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1245 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:28.676813 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bc2f2064-58d1-488e-9b2d-a0e91c004efe tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:28.716732 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bc2f2064-58d1-488e-9b2d-a0e91c004efe tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:28.743428 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bc2f2064-58d1-488e-9b2d-a0e91c004efe tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:28.751371 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-bc2f2064-58d1-488e-9b2d-a0e91c004efe tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1352 microversion: 2.20 time: 0.382503 May 26 13:56:28.755275 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 29/55] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:28 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1352 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:56:28.992715 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f4a96ecb-151d-4d5d-bef9-9cde3cce159c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:28.993323 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f4a96ecb-151d-4d5d-bef9-9cde3cce159c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:29.008042 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f4a96ecb-151d-4d5d-bef9-9cde3cce159c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:29.008546 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f4a96ecb-151d-4d5d-bef9-9cde3cce159c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:29.016070 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f4a96ecb-151d-4d5d-bef9-9cde3cce159c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:29.016602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f4a96ecb-151d-4d5d-bef9-9cde3cce159c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:29.534816 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f4a96ecb-151d-4d5d-bef9-9cde3cce159c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:29.550808 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f4a96ecb-151d-4d5d-bef9-9cde3cce159c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1282 microversion: 2.1 time: 0.562663 May 26 13:56:29.559473 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 30/56] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:28 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1282 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:29.570043 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8bc11f99-47e7-4c04-8e9e-9a2b36169d94 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:29.575349 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8bc11f99-47e7-4c04-8e9e-9a2b36169d94 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:29.592658 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8bc11f99-47e7-4c04-8e9e-9a2b36169d94 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:29.595930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8bc11f99-47e7-4c04-8e9e-9a2b36169d94 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:29.596980 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8bc11f99-47e7-4c04-8e9e-9a2b36169d94 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:29.604532 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8bc11f99-47e7-4c04-8e9e-9a2b36169d94 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:29.801671 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-5fcb8716-9206-414e-a53a-e77c3b0e80ce req-e0129e3c-bb31-48f3-9761-53d34e984deb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8503557-47d9-4fc4-ad98-e698f675e2ce", "tag": "f8d0143b-9f68-4c1b-a919-a3a667b7d168"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:29.837119 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-5fcb8716-9206-414e-a53a-e77c3b0e80ce req-e0129e3c-bb31-48f3-9761-53d34e984deb service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:29.842152 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-5fcb8716-9206-414e-a53a-e77c3b0e80ce req-e0129e3c-bb31-48f3-9761-53d34e984deb service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:29.895898 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-5fcb8716-9206-414e-a53a-e77c3b0e80ce req-e0129e3c-bb31-48f3-9761-53d34e984deb service nova] Creating event network-changed:f8d0143b-9f68-4c1b-a919-a3a667b7d168 for instance a8503557-47d9-4fc4-ad98-e698f675e2ce on hv-cinder-84213 May 26 13:56:29.897989 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-5fcb8716-9206-414e-a53a-e77c3b0e80ce req-e0129e3c-bb31-48f3-9761-53d34e984deb service nova] Acquired lock "compute-rpcapi-router" {{(pid=117787) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 13:56:29.902194 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3267b275-06bb-44b2-92c7-21531343fe0a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:29.902993 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3267b275-06bb-44b2-92c7-21531343fe0a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:29.908199 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3267b275-06bb-44b2-92c7-21531343fe0a None None] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:29.908963 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3267b275-06bb-44b2-92c7-21531343fe0a None None] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:29.937698 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8bc11f99-47e7-4c04-8e9e-9a2b36169d94 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:29.949371 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8bc11f99-47e7-4c04-8e9e-9a2b36169d94 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.388486 May 26 13:56:29.951257 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.compute.rpcapi [None req-3267b275-06bb-44b2-92c7-21531343fe0a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 13:56:29.953573 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3267b275-06bb-44b2-92c7-21531343fe0a None None] Releasing lock "compute-rpcapi-router" {{(pid=117787) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 13:56:29.960482 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 31/57] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:29 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:29.972508 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2d4d0b56-acd6-4537-8c00-17ec7151fcf1 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:29.973500 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2d4d0b56-acd6-4537-8c00-17ec7151fcf1 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:29.980984 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2d4d0b56-acd6-4537-8c00-17ec7151fcf1 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:29.982274 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2d4d0b56-acd6-4537-8c00-17ec7151fcf1 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:29.985036 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2d4d0b56-acd6-4537-8c00-17ec7151fcf1 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:29.985906 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2d4d0b56-acd6-4537-8c00-17ec7151fcf1 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:29.996899 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3267b275-06bb-44b2-92c7-21531343fe0a None None] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.103538 May 26 13:56:29.997628 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 27/58] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 13:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:56:30.018913 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ebeb0aeb-ecf7-41d5-aecd-99a4d79bfa0a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:30.021292 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ebeb0aeb-ecf7-41d5-aecd-99a4d79bfa0a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:30.060773 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ebeb0aeb-ecf7-41d5-aecd-99a4d79bfa0a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:30.062921 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ebeb0aeb-ecf7-41d5-aecd-99a4d79bfa0a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:30.067072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ebeb0aeb-ecf7-41d5-aecd-99a4d79bfa0a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:30.068470 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ebeb0aeb-ecf7-41d5-aecd-99a4d79bfa0a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:30.075549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2d4d0b56-acd6-4537-8c00-17ec7151fcf1 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:30.080041 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:30.086721 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2d4d0b56-acd6-4537-8c00-17ec7151fcf1 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1293 microversion: 2.1 time: 0.123982 May 26 13:56:30.088936 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 32/59] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:29 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1293 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:30.261530 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ebeb0aeb-ecf7-41d5-aecd-99a4d79bfa0a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:30.272243 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ebeb0aeb-ecf7-41d5-aecd-99a4d79bfa0a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:30.280304 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ebeb0aeb-ecf7-41d5-aecd-99a4d79bfa0a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:30.286106 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ebeb0aeb-ecf7-41d5-aecd-99a4d79bfa0a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1340 microversion: 2.20 time: 0.285387 May 26 13:56:30.287368 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 28/60] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:29 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1340 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:56:30.575837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-eb0bb54b-8fc2-4548-a9ce-f7885c8eb0cb tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:30.576722 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-eb0bb54b-8fc2-4548-a9ce-f7885c8eb0cb tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:30.600128 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:30.602586 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb0bb54b-8fc2-4548-a9ce-f7885c8eb0cb tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:30.606639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb0bb54b-8fc2-4548-a9ce-f7885c8eb0cb tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:30.608051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb0bb54b-8fc2-4548-a9ce-f7885c8eb0cb tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:30.611024 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb0bb54b-8fc2-4548-a9ce-f7885c8eb0cb tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:30.974245 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3f25f9ae-ae07-4181-81da-19e7bce6fac5 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:30.975086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3f25f9ae-ae07-4181-81da-19e7bce6fac5 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:31.004049 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f25f9ae-ae07-4181-81da-19e7bce6fac5 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:31.007740 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f25f9ae-ae07-4181-81da-19e7bce6fac5 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:31.016506 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f25f9ae-ae07-4181-81da-19e7bce6fac5 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:31.017676 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f25f9ae-ae07-4181-81da-19e7bce6fac5 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:31.136446 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=4 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:31.184984 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-eb0bb54b-8fc2-4548-a9ce-f7885c8eb0cb tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:31.195612 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-eb0bb54b-8fc2-4548-a9ce-f7885c8eb0cb tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1292 microversion: 2.1 time: 0.623468 May 26 13:56:31.210864 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 33/61] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:30 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1292 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:31.231089 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e2f557ab-a9c8-474f-a9f7-5c1546e70cb4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:31.231979 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e2f557ab-a9c8-474f-a9f7-5c1546e70cb4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:31.254790 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e2f557ab-a9c8-474f-a9f7-5c1546e70cb4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:31.258322 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e2f557ab-a9c8-474f-a9f7-5c1546e70cb4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:31.260186 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e2f557ab-a9c8-474f-a9f7-5c1546e70cb4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:31.260860 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e2f557ab-a9c8-474f-a9f7-5c1546e70cb4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:31.602987 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e2f557ab-a9c8-474f-a9f7-5c1546e70cb4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:31.612675 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e2f557ab-a9c8-474f-a9f7-5c1546e70cb4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1299 microversion: 2.1 time: 0.399121 May 26 13:56:31.629024 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 34/62] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:31 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1299 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:31.639990 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4ef24435-6213-4f59-aa83-b926db246433 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:31.644988 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4ef24435-6213-4f59-aa83-b926db246433 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:31.653591 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4ef24435-6213-4f59-aa83-b926db246433 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:31.656706 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4ef24435-6213-4f59-aa83-b926db246433 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:31.659487 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4ef24435-6213-4f59-aa83-b926db246433 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:31.660200 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4ef24435-6213-4f59-aa83-b926db246433 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:32.010021 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4ef24435-6213-4f59-aa83-b926db246433 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:32.056947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4ef24435-6213-4f59-aa83-b926db246433 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:32.075036 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4ef24435-6213-4f59-aa83-b926db246433 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:32.075036 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4ef24435-6213-4f59-aa83-b926db246433 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1340 microversion: 2.20 time: 0.442872 May 26 13:56:32.075036 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 35/63] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:31 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1340 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:56:32.227229 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-bd699b97-7df5-4736-ac07-79759faf81f5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:32.228882 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-bd699b97-7df5-4736-ac07-79759faf81f5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:32.244258 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bd699b97-7df5-4736-ac07-79759faf81f5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:32.250562 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bd699b97-7df5-4736-ac07-79759faf81f5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:32.259798 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bd699b97-7df5-4736-ac07-79759faf81f5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:32.269621 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bd699b97-7df5-4736-ac07-79759faf81f5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:32.868226 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3f25f9ae-ae07-4181-81da-19e7bce6fac5 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:32.870705 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=87 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:32.882264 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3f25f9ae-ae07-4181-81da-19e7bce6fac5 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 1.918771 May 26 13:56:32.902119 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 29/64] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:30 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:32.908620 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7a157f0a-3cbe-48ba-a076-9016592ddc91 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:32.909651 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7a157f0a-3cbe-48ba-a076-9016592ddc91 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:32.923065 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7a157f0a-3cbe-48ba-a076-9016592ddc91 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:32.930256 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7a157f0a-3cbe-48ba-a076-9016592ddc91 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:32.931432 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7a157f0a-3cbe-48ba-a076-9016592ddc91 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:32.932104 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7a157f0a-3cbe-48ba-a076-9016592ddc91 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:33.006317 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bd699b97-7df5-4736-ac07-79759faf81f5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:33.037252 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-bd699b97-7df5-4736-ac07-79759faf81f5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1280 microversion: 2.1 time: 0.808362 May 26 13:56:33.038231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 36/65] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:32 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1280 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:33.091621 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b6645be5-1d41-4566-a986-39d6ef097f86 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:33.092229 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b6645be5-1d41-4566-a986-39d6ef097f86 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:33.121371 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b6645be5-1d41-4566-a986-39d6ef097f86 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:33.122054 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b6645be5-1d41-4566-a986-39d6ef097f86 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:33.123057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b6645be5-1d41-4566-a986-39d6ef097f86 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:33.123647 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b6645be5-1d41-4566-a986-39d6ef097f86 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:33.256021 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7a157f0a-3cbe-48ba-a076-9016592ddc91 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:33.267425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7a157f0a-3cbe-48ba-a076-9016592ddc91 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1299 microversion: 2.1 time: 0.363466 May 26 13:56:33.268370 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 30/66] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:32 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1299 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:33.330066 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b6645be5-1d41-4566-a986-39d6ef097f86 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:33.343896 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b6645be5-1d41-4566-a986-39d6ef097f86 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:33.346299 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b6645be5-1d41-4566-a986-39d6ef097f86 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:33.348817 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b6645be5-1d41-4566-a986-39d6ef097f86 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1340 microversion: 2.20 time: 0.261078 May 26 13:56:33.350425 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 37/67] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:33 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1340 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:56:33.911475 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-53937401-764e-48c9-a2d5-79e284400cae tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:33.912092 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-53937401-764e-48c9-a2d5-79e284400cae tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:33.925295 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-53937401-764e-48c9-a2d5-79e284400cae tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:33.925945 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-53937401-764e-48c9-a2d5-79e284400cae tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:33.926886 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-53937401-764e-48c9-a2d5-79e284400cae tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:33.927469 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-53937401-764e-48c9-a2d5-79e284400cae tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:34.073673 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7be5397b-39a1-40c3-bcda-4137442279f3 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:34.075404 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7be5397b-39a1-40c3-bcda-4137442279f3 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:34.096326 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7be5397b-39a1-40c3-bcda-4137442279f3 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:34.100249 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7be5397b-39a1-40c3-bcda-4137442279f3 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:34.105319 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7be5397b-39a1-40c3-bcda-4137442279f3 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:34.106708 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7be5397b-39a1-40c3-bcda-4137442279f3 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:34.198811 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-53937401-764e-48c9-a2d5-79e284400cae tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:34.213300 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-53937401-764e-48c9-a2d5-79e284400cae tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.307142 May 26 13:56:34.214800 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 31/68] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:33 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:34.286405 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a2f43038-0b66-47bc-abd1-07b4e6ecf393 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:34.287025 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a2f43038-0b66-47bc-abd1-07b4e6ecf393 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:34.301005 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a2f43038-0b66-47bc-abd1-07b4e6ecf393 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:34.305875 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a2f43038-0b66-47bc-abd1-07b4e6ecf393 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:34.307211 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a2f43038-0b66-47bc-abd1-07b4e6ecf393 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:34.308301 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a2f43038-0b66-47bc-abd1-07b4e6ecf393 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:34.351139 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7be5397b-39a1-40c3-bcda-4137442279f3 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:34.367451 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7be5397b-39a1-40c3-bcda-4137442279f3 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1280 microversion: 2.1 time: 0.315792 May 26 13:56:34.371391 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 38/69] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:34 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1280 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:34.391327 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-26457908-9faa-4d04-9ae4-4f3ec12b2ea3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:34.393644 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-26457908-9faa-4d04-9ae4-4f3ec12b2ea3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:34.410613 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-26457908-9faa-4d04-9ae4-4f3ec12b2ea3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:34.413141 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-26457908-9faa-4d04-9ae4-4f3ec12b2ea3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:34.414584 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-26457908-9faa-4d04-9ae4-4f3ec12b2ea3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:34.416027 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-26457908-9faa-4d04-9ae4-4f3ec12b2ea3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:34.693386 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=28 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:34.904934 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-26457908-9faa-4d04-9ae4-4f3ec12b2ea3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:34.919153 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-26457908-9faa-4d04-9ae4-4f3ec12b2ea3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:34.920874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-26457908-9faa-4d04-9ae4-4f3ec12b2ea3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:34.922621 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-26457908-9faa-4d04-9ae4-4f3ec12b2ea3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.548823 May 26 13:56:34.926848 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 39/70] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:34 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:56:35.019820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a2f43038-0b66-47bc-abd1-07b4e6ecf393 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:35.032644 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a2f43038-0b66-47bc-abd1-07b4e6ecf393 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1367 microversion: 2.1 time: 0.750106 May 26 13:56:35.038237 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 32/71] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:34 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1367 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:56:35.232791 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-115d71a0-dab2-4251-b8cb-ed076739c744 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:35.233666 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-115d71a0-dab2-4251-b8cb-ed076739c744 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:35.240607 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-115d71a0-dab2-4251-b8cb-ed076739c744 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:35.246729 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-115d71a0-dab2-4251-b8cb-ed076739c744 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:35.247960 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-115d71a0-dab2-4251-b8cb-ed076739c744 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:35.248412 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-115d71a0-dab2-4251-b8cb-ed076739c744 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:35.386717 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-de26ab55-52d9-4d4f-bbf4-d861e6a567fa tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:35.387337 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-de26ab55-52d9-4d4f-bbf4-d861e6a567fa tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:35.400712 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-de26ab55-52d9-4d4f-bbf4-d861e6a567fa tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:35.401183 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-de26ab55-52d9-4d4f-bbf4-d861e6a567fa tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:35.402042 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-de26ab55-52d9-4d4f-bbf4-d861e6a567fa tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:35.402487 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-de26ab55-52d9-4d4f-bbf4-d861e6a567fa tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:35.409487 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=18 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:35.878997 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-de26ab55-52d9-4d4f-bbf4-d861e6a567fa tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:35.895402 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-de26ab55-52d9-4d4f-bbf4-d861e6a567fa tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.512439 May 26 13:56:35.896233 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 33/72] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:35 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:35.941201 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-532abb4f-6926-4982-9543-0e3389d0aa29 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:35.941755 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-532abb4f-6926-4982-9543-0e3389d0aa29 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:35.951960 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-532abb4f-6926-4982-9543-0e3389d0aa29 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:35.953609 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-532abb4f-6926-4982-9543-0e3389d0aa29 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:35.955798 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-532abb4f-6926-4982-9543-0e3389d0aa29 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:35.956247 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-532abb4f-6926-4982-9543-0e3389d0aa29 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:36.039772 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-115d71a0-dab2-4251-b8cb-ed076739c744 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:36.059213 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-115d71a0-dab2-4251-b8cb-ed076739c744 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.830784 May 26 13:56:36.060399 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 40/73] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:35 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:36.066174 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-054990f6-5cef-4fca-b658-5affb6eb91df tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:36.067107 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-054990f6-5cef-4fca-b658-5affb6eb91df tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:36.075734 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-054990f6-5cef-4fca-b658-5affb6eb91df tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:36.076613 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-054990f6-5cef-4fca-b658-5affb6eb91df tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:36.077884 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-054990f6-5cef-4fca-b658-5affb6eb91df tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:36.078474 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-054990f6-5cef-4fca-b658-5affb6eb91df tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:36.527708 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-532abb4f-6926-4982-9543-0e3389d0aa29 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:36.542070 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-532abb4f-6926-4982-9543-0e3389d0aa29 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:36.545920 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-532abb4f-6926-4982-9543-0e3389d0aa29 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:36.552108 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-532abb4f-6926-4982-9543-0e3389d0aa29 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.615605 May 26 13:56:36.554331 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 34/74] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:35 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:56:36.605260 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-054990f6-5cef-4fca-b658-5affb6eb91df tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:36.615798 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-054990f6-5cef-4fca-b658-5affb6eb91df tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1367 microversion: 2.1 time: 0.554178 May 26 13:56:36.618671 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 41/75] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:36 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1367 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:36.912845 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2b0aac45-bcca-42ee-938d-b74be9eb373e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:36.913574 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2b0aac45-bcca-42ee-938d-b74be9eb373e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:36.934665 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2b0aac45-bcca-42ee-938d-b74be9eb373e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:36.941065 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2b0aac45-bcca-42ee-938d-b74be9eb373e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:36.951608 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2b0aac45-bcca-42ee-938d-b74be9eb373e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:36.955794 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2b0aac45-bcca-42ee-938d-b74be9eb373e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:37.082915 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4478f7bf-a3ae-42ee-b848-bf44cc5f1720 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:37.084082 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4478f7bf-a3ae-42ee-b848-bf44cc5f1720 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:37.092015 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4478f7bf-a3ae-42ee-b848-bf44cc5f1720 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:37.096962 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4478f7bf-a3ae-42ee-b848-bf44cc5f1720 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:37.100947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4478f7bf-a3ae-42ee-b848-bf44cc5f1720 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:37.101718 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4478f7bf-a3ae-42ee-b848-bf44cc5f1720 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:38.078656 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2b0aac45-bcca-42ee-938d-b74be9eb373e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:38.088860 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2b0aac45-bcca-42ee-938d-b74be9eb373e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 1.180342 May 26 13:56:38.091828 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 35/76] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:36 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:38.099464 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-424619c5-d795-4cd2-a3b9-7a01d95ea84e req-652c584e-9c83-4646-be29-1947edcf8c8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71af8283-a8f5-44e7-bdcd-6606070472b2", "tag": "44b52c9b-2e5c-490a-ab42-cd30ca4bea28"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:38.139009 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-424619c5-d795-4cd2-a3b9-7a01d95ea84e req-652c584e-9c83-4646-be29-1947edcf8c8f service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:38.140223 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-424619c5-d795-4cd2-a3b9-7a01d95ea84e req-652c584e-9c83-4646-be29-1947edcf8c8f service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:38.156432 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-424619c5-d795-4cd2-a3b9-7a01d95ea84e req-652c584e-9c83-4646-be29-1947edcf8c8f service nova] Creating event network-changed:44b52c9b-2e5c-490a-ab42-cd30ca4bea28 for instance 71af8283-a8f5-44e7-bdcd-6606070472b2 on hv-cinder-84213 May 26 13:56:38.164334 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-424619c5-d795-4cd2-a3b9-7a01d95ea84e req-652c584e-9c83-4646-be29-1947edcf8c8f service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068669 May 26 13:56:38.165199 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 36/77] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 13:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:56:38.178260 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1b17518d-26b1-41d6-bf92-8a50e53a39a9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:38.179994 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1b17518d-26b1-41d6-bf92-8a50e53a39a9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:38.187272 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4478f7bf-a3ae-42ee-b848-bf44cc5f1720 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:38.196282 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1b17518d-26b1-41d6-bf92-8a50e53a39a9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:38.201355 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1b17518d-26b1-41d6-bf92-8a50e53a39a9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:38.202541 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1b17518d-26b1-41d6-bf92-8a50e53a39a9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:38.203186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1b17518d-26b1-41d6-bf92-8a50e53a39a9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:38.207017 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4478f7bf-a3ae-42ee-b848-bf44cc5f1720 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 1.132835 May 26 13:56:38.209597 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 42/78] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:37 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:38.220259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f2dd150d-b39a-4ff6-b0db-dca94da197ed tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:38.222512 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f2dd150d-b39a-4ff6-b0db-dca94da197ed tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:38.242531 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f2dd150d-b39a-4ff6-b0db-dca94da197ed tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:38.243236 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f2dd150d-b39a-4ff6-b0db-dca94da197ed tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:38.244574 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f2dd150d-b39a-4ff6-b0db-dca94da197ed tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:38.245256 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f2dd150d-b39a-4ff6-b0db-dca94da197ed tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:38.922827 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f2dd150d-b39a-4ff6-b0db-dca94da197ed tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:38.930215 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f2dd150d-b39a-4ff6-b0db-dca94da197ed tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1367 microversion: 2.1 time: 0.719027 May 26 13:56:38.930799 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 43/79] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:38 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1367 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:38.979922 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1b17518d-26b1-41d6-bf92-8a50e53a39a9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:38.996244 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1b17518d-26b1-41d6-bf92-8a50e53a39a9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:38.999273 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1b17518d-26b1-41d6-bf92-8a50e53a39a9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:39.000418 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1b17518d-26b1-41d6-bf92-8a50e53a39a9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.832778 May 26 13:56:39.001327 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 37/80] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:38 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:56:39.109698 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6ef18892-5572-489a-9416-e2c33ac5e482 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:39.110362 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6ef18892-5572-489a-9416-e2c33ac5e482 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:39.128427 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6ef18892-5572-489a-9416-e2c33ac5e482 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:39.128888 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6ef18892-5572-489a-9416-e2c33ac5e482 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:39.129762 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6ef18892-5572-489a-9416-e2c33ac5e482 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:39.131463 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6ef18892-5572-489a-9416-e2c33ac5e482 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:39.260106 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-aa119eb3-d27e-4b7b-95fe-99911e1b5e68 req-7360cbed-09c3-4d77-9973-4c5303585124 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b980b635-eece-4c60-9b6c-e18d32bdc7da", "tag": "d789974b-4593-46b6-9ee2-38b74839df10"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:39.280849 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-aa119eb3-d27e-4b7b-95fe-99911e1b5e68 req-7360cbed-09c3-4d77-9973-4c5303585124 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:39.281320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-aa119eb3-d27e-4b7b-95fe-99911e1b5e68 req-7360cbed-09c3-4d77-9973-4c5303585124 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:39.324639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-aa119eb3-d27e-4b7b-95fe-99911e1b5e68 req-7360cbed-09c3-4d77-9973-4c5303585124 service nova] Creating event network-changed:d789974b-4593-46b6-9ee2-38b74839df10 for instance b980b635-eece-4c60-9b6c-e18d32bdc7da on hv-cinder-84213 May 26 13:56:39.325219 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-aa119eb3-d27e-4b7b-95fe-99911e1b5e68 req-7360cbed-09c3-4d77-9973-4c5303585124 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 13:56:39.326327 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-22b21f1a-d9a4-40d0-9813-e9f2ce51fc45 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:39.326760 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-22b21f1a-d9a4-40d0-9813-e9f2ce51fc45 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:39.327569 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-22b21f1a-d9a4-40d0-9813-e9f2ce51fc45 None None] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:39.327989 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-22b21f1a-d9a4-40d0-9813-e9f2ce51fc45 None None] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:39.337065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.compute.rpcapi [None req-22b21f1a-d9a4-40d0-9813-e9f2ce51fc45 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 13:56:39.338479 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-22b21f1a-d9a4-40d0-9813-e9f2ce51fc45 None None] Releasing lock "compute-rpcapi-router" {{(pid=117788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 13:56:39.360547 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-22b21f1a-d9a4-40d0-9813-e9f2ce51fc45 None None] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.416221 May 26 13:56:39.361353 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 44/81] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 13:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:56:39.367857 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-17624eb8-8fe3-4896-80cc-9f1f21663c67 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:39.368561 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-17624eb8-8fe3-4896-80cc-9f1f21663c67 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:39.379023 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-17624eb8-8fe3-4896-80cc-9f1f21663c67 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:39.379664 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-17624eb8-8fe3-4896-80cc-9f1f21663c67 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:39.380615 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-17624eb8-8fe3-4896-80cc-9f1f21663c67 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:39.381053 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-17624eb8-8fe3-4896-80cc-9f1f21663c67 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:39.843775 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6ef18892-5572-489a-9416-e2c33ac5e482 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:39.863831 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6ef18892-5572-489a-9416-e2c33ac5e482 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.757922 May 26 13:56:39.867036 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 38/82] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:39 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:56:39.960004 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b9d1287b-7085-40d3-8fa1-457519575cc7 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:39.963198 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b9d1287b-7085-40d3-8fa1-457519575cc7 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:39.972348 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=6 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:39.972527 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-17624eb8-8fe3-4896-80cc-9f1f21663c67 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:39.982563 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b9d1287b-7085-40d3-8fa1-457519575cc7 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:39.983342 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b9d1287b-7085-40d3-8fa1-457519575cc7 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:39.985509 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b9d1287b-7085-40d3-8fa1-457519575cc7 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:39.987213 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b9d1287b-7085-40d3-8fa1-457519575cc7 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:39.991448 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-17624eb8-8fe3-4896-80cc-9f1f21663c67 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.628578 May 26 13:56:39.992046 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 45/83] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:39 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:40.019393 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3c12558b-ec9d-4304-82e4-0f6b0b07736a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:40.020094 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3c12558b-ec9d-4304-82e4-0f6b0b07736a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:40.031175 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c12558b-ec9d-4304-82e4-0f6b0b07736a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:40.033422 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c12558b-ec9d-4304-82e4-0f6b0b07736a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:40.034361 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c12558b-ec9d-4304-82e4-0f6b0b07736a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:40.035429 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c12558b-ec9d-4304-82e4-0f6b0b07736a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:40.338870 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b9d1287b-7085-40d3-8fa1-457519575cc7 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:40.349806 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b9d1287b-7085-40d3-8fa1-457519575cc7 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1367 microversion: 2.1 time: 0.404967 May 26 13:56:40.350399 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 39/84] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:39 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1367 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:40.359730 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-1eb2d9de-e291-4708-8a58-fcb4e5b4f8e5 req-bf3b842f-35ba-4925-bf22-7f249f6ec716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9116ee60-50e6-48c5-bcc1-8e9d08e35458", "tag": "0d486a1e-7691-438f-a89c-df9425b682f1"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:40.366848 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3c12558b-ec9d-4304-82e4-0f6b0b07736a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:40.377644 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3c12558b-ec9d-4304-82e4-0f6b0b07736a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:40.379149 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3c12558b-ec9d-4304-82e4-0f6b0b07736a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:40.380474 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3c12558b-ec9d-4304-82e4-0f6b0b07736a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.366477 May 26 13:56:40.380908 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-1eb2d9de-e291-4708-8a58-fcb4e5b4f8e5 req-bf3b842f-35ba-4925-bf22-7f249f6ec716 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:40.381408 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 46/85] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:40 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:56:40.381873 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-1eb2d9de-e291-4708-8a58-fcb4e5b4f8e5 req-bf3b842f-35ba-4925-bf22-7f249f6ec716 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:40.386436 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b02e939d-a6ca-49e2-bc2a-000570364e2c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-497074730", "imageRef": "bcaacfae-fe2c-455f-a6e1-b08361c6fa8c", "flavorRef": "452"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:40.402112 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-1eb2d9de-e291-4708-8a58-fcb4e5b4f8e5 req-bf3b842f-35ba-4925-bf22-7f249f6ec716 service nova] Creating event network-changed:0d486a1e-7691-438f-a89c-df9425b682f1 for instance 9116ee60-50e6-48c5-bcc1-8e9d08e35458 on hv-cinder-84213 May 26 13:56:40.415108 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-1eb2d9de-e291-4708-8a58-fcb4e5b4f8e5 req-bf3b842f-35ba-4925-bf22-7f249f6ec716 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063277 May 26 13:56:40.415963 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 40/86] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 13:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:56:40.464627 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-b02e939d-a6ca-49e2-bc2a-000570364e2c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] validate_networks() for None {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:56:40.801617 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-b02e939d-a6ca-49e2-bc2a-000570364e2c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:56:40.802036 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-b02e939d-a6ca-49e2-bc2a-000570364e2c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:56:40.802545 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-b02e939d-a6ca-49e2-bc2a-000570364e2c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:56:40.802947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-b02e939d-a6ca-49e2-bc2a-000570364e2c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:56:40.803347 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-b02e939d-a6ca-49e2-bc2a-000570364e2c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:56:40.812458 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b02e939d-a6ca-49e2-bc2a-000570364e2c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:40.812895 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b02e939d-a6ca-49e2-bc2a-000570364e2c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:40.813708 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b02e939d-a6ca-49e2-bc2a-000570364e2c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:40.814142 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b02e939d-a6ca-49e2-bc2a-000570364e2c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:40.830703 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-b02e939d-a6ca-49e2-bc2a-000570364e2c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Getting quotas for project 0926e6ea11a2454e9a5b4ef6c5fd2d96. Resources: {'ram', 'cores', 'instances'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:56:40.834635 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-b02e939d-a6ca-49e2-bc2a-000570364e2c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Getting quotas for user f90654dfe0c94d2ab61872dd244f4d81 and project 0926e6ea11a2454e9a5b4ef6c5fd2d96. Resources: {'ram', 'cores', 'instances'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:56:40.845964 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b02e939d-a6ca-49e2-bc2a-000570364e2c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:56:40.848320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b02e939d-a6ca-49e2-bc2a-000570364e2c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bcaacfae-fe2c-455f-a6e1-b08361c6fa8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:56:40.883903 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e43f3322-b557-47f6-bcda-6e7b17d34da8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:40.884605 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e43f3322-b557-47f6-bcda-6e7b17d34da8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:40.891452 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e43f3322-b557-47f6-bcda-6e7b17d34da8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:40.892178 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e43f3322-b557-47f6-bcda-6e7b17d34da8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:40.893165 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e43f3322-b557-47f6-bcda-6e7b17d34da8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:40.893793 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e43f3322-b557-47f6-bcda-6e7b17d34da8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:40.903788 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b02e939d-a6ca-49e2-bc2a-000570364e2c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520810 May 26 13:56:40.904441 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 47/87] 10.222.0.91 () {60 vars in 1146 bytes} [Thu May 26 13:56:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:56:40.914139 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-17b28228-907d-463c-9af4-807d6cb541a6 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:40.914725 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-17b28228-907d-463c-9af4-807d6cb541a6 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:41.005607 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-17b28228-907d-463c-9af4-807d6cb541a6 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:41.017408 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-17b28228-907d-463c-9af4-807d6cb541a6 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1214 microversion: 2.1 time: 0.106771 May 26 13:56:41.026594 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 48/88] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:40 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:56:41.026594 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-de467c1b-eaa6-4d4a-ba90-381fda6576a9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:41.026594 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-de467c1b-eaa6-4d4a-ba90-381fda6576a9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:41.042796 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-de467c1b-eaa6-4d4a-ba90-381fda6576a9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:41.043249 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-de467c1b-eaa6-4d4a-ba90-381fda6576a9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:41.044039 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-de467c1b-eaa6-4d4a-ba90-381fda6576a9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:41.048429 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-de467c1b-eaa6-4d4a-ba90-381fda6576a9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:41.069557 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e43f3322-b557-47f6-bcda-6e7b17d34da8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:41.077892 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e43f3322-b557-47f6-bcda-6e7b17d34da8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.198136 May 26 13:56:41.087414 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 41/89] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:40 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:56:41.241329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-de467c1b-eaa6-4d4a-ba90-381fda6576a9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:41.250151 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-de467c1b-eaa6-4d4a-ba90-381fda6576a9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.231184 May 26 13:56:41.250943 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 49/90] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:41 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:41.368577 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7dcab761-851d-41ff-b856-d5eb3ecda730 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:41.369341 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7dcab761-851d-41ff-b856-d5eb3ecda730 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:41.376483 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7dcab761-851d-41ff-b856-d5eb3ecda730 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:41.377258 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7dcab761-851d-41ff-b856-d5eb3ecda730 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:41.378145 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7dcab761-851d-41ff-b856-d5eb3ecda730 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:41.378589 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7dcab761-851d-41ff-b856-d5eb3ecda730 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:41.383815 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-ae1e579c-94b8-44bd-affb-e01f23e2fe7b req-a62ac51a-77f3-4e8d-9499-bd37a6b7a4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e953c9eb-adb5-49a2-b9c2-03633d118240", "tag": "9ea477a5-0b77-466c-b782-069bc53617e5"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:41.406534 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-ae1e579c-94b8-44bd-affb-e01f23e2fe7b req-a62ac51a-77f3-4e8d-9499-bd37a6b7a4b0 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:41.406981 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-ae1e579c-94b8-44bd-affb-e01f23e2fe7b req-a62ac51a-77f3-4e8d-9499-bd37a6b7a4b0 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:41.419861 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-ae1e579c-94b8-44bd-affb-e01f23e2fe7b req-a62ac51a-77f3-4e8d-9499-bd37a6b7a4b0 service nova] Creating event network-changed:9ea477a5-0b77-466c-b782-069bc53617e5 for instance e953c9eb-adb5-49a2-b9c2-03633d118240 on hv-cinder-84213 May 26 13:56:41.429545 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-ae1e579c-94b8-44bd-affb-e01f23e2fe7b req-a62ac51a-77f3-4e8d-9499-bd37a6b7a4b0 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049096 May 26 13:56:41.430165 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 50/91] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 13:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:56:41.436513 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-30b0e722-3933-4935-8524-b970d8345c1d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:41.437229 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-30b0e722-3933-4935-8524-b970d8345c1d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:41.443582 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-30b0e722-3933-4935-8524-b970d8345c1d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:41.444027 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-30b0e722-3933-4935-8524-b970d8345c1d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:41.444786 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-30b0e722-3933-4935-8524-b970d8345c1d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:41.445245 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-30b0e722-3933-4935-8524-b970d8345c1d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:41.653410 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7dcab761-851d-41ff-b856-d5eb3ecda730 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:41.661917 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7dcab761-851d-41ff-b856-d5eb3ecda730 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1367 microversion: 2.1 time: 0.297395 May 26 13:56:41.662688 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 42/92] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:41 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1367 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:41.675654 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-30b0e722-3933-4935-8524-b970d8345c1d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:41.683827 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-30b0e722-3933-4935-8524-b970d8345c1d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:41.685375 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-30b0e722-3933-4935-8524-b970d8345c1d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:41.686467 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-30b0e722-3933-4935-8524-b970d8345c1d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.254522 May 26 13:56:41.687031 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 51/93] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:41 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:56:42.034826 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-88732e8f-937f-4eca-8bc9-7a6f94128eaa tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:42.035716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-88732e8f-937f-4eca-8bc9-7a6f94128eaa tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:42.041908 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-88732e8f-937f-4eca-8bc9-7a6f94128eaa tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:42.042361 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-88732e8f-937f-4eca-8bc9-7a6f94128eaa tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:42.043122 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-88732e8f-937f-4eca-8bc9-7a6f94128eaa tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:42.043553 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-88732e8f-937f-4eca-8bc9-7a6f94128eaa tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:42.095747 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a2399cb7-71d1-4e9c-a23c-3140d37860b5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:42.096362 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a2399cb7-71d1-4e9c-a23c-3140d37860b5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:42.111246 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2399cb7-71d1-4e9c-a23c-3140d37860b5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:42.111699 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2399cb7-71d1-4e9c-a23c-3140d37860b5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:42.112478 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2399cb7-71d1-4e9c-a23c-3140d37860b5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:42.112916 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2399cb7-71d1-4e9c-a23c-3140d37860b5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:42.119342 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-88732e8f-937f-4eca-8bc9-7a6f94128eaa tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:42.125827 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:42.127121 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-88732e8f-937f-4eca-8bc9-7a6f94128eaa tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1218 microversion: 2.1 time: 0.096812 May 26 13:56:42.136774 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 43/94] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:42 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:42.269054 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-eca846ce-83a3-4b90-8859-e802eadf81bf tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:42.269982 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-eca846ce-83a3-4b90-8859-e802eadf81bf tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:42.276210 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eca846ce-83a3-4b90-8859-e802eadf81bf tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:42.276969 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eca846ce-83a3-4b90-8859-e802eadf81bf tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:42.278237 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eca846ce-83a3-4b90-8859-e802eadf81bf tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:42.278882 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eca846ce-83a3-4b90-8859-e802eadf81bf tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:42.291260 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a2399cb7-71d1-4e9c-a23c-3140d37860b5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:42.301221 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a2399cb7-71d1-4e9c-a23c-3140d37860b5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.210625 May 26 13:56:42.305831 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 52/95] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:42 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:56:42.442204 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-eca846ce-83a3-4b90-8859-e802eadf81bf tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:42.449753 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-eca846ce-83a3-4b90-8859-e802eadf81bf tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.185852 May 26 13:56:42.450456 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 44/96] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:42 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:56:42.679796 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6c37bcbb-8c80-4408-9a0d-4d5fea00f138 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:42.680478 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6c37bcbb-8c80-4408-9a0d-4d5fea00f138 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:42.687254 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c37bcbb-8c80-4408-9a0d-4d5fea00f138 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:42.687641 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c37bcbb-8c80-4408-9a0d-4d5fea00f138 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:42.688407 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c37bcbb-8c80-4408-9a0d-4d5fea00f138 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:42.688857 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c37bcbb-8c80-4408-9a0d-4d5fea00f138 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:42.703599 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b63f4577-d1e6-498e-ac8d-efc9e2cdc9cb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:42.704208 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b63f4577-d1e6-498e-ac8d-efc9e2cdc9cb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:42.710534 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b63f4577-d1e6-498e-ac8d-efc9e2cdc9cb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:42.711216 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b63f4577-d1e6-498e-ac8d-efc9e2cdc9cb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:42.712164 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b63f4577-d1e6-498e-ac8d-efc9e2cdc9cb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:42.712600 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b63f4577-d1e6-498e-ac8d-efc9e2cdc9cb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:42.889527 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6c37bcbb-8c80-4408-9a0d-4d5fea00f138 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:42.897826 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6c37bcbb-8c80-4408-9a0d-4d5fea00f138 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1367 microversion: 2.1 time: 0.222210 May 26 13:56:42.901698 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 53/97] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:42 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:42.905633 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b63f4577-d1e6-498e-ac8d-efc9e2cdc9cb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:42.913593 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b63f4577-d1e6-498e-ac8d-efc9e2cdc9cb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:42.915110 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b63f4577-d1e6-498e-ac8d-efc9e2cdc9cb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:42.916210 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b63f4577-d1e6-498e-ac8d-efc9e2cdc9cb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.216482 May 26 13:56:42.916767 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 45/98] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:42 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:56:43.143904 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6c274c50-5e5b-433e-a46b-3ecc80f7b8db tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:43.144499 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6c274c50-5e5b-433e-a46b-3ecc80f7b8db tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:43.150423 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c274c50-5e5b-433e-a46b-3ecc80f7b8db tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:43.150862 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c274c50-5e5b-433e-a46b-3ecc80f7b8db tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:43.151615 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c274c50-5e5b-433e-a46b-3ecc80f7b8db tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:43.152047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c274c50-5e5b-433e-a46b-3ecc80f7b8db tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:43.221413 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6c274c50-5e5b-433e-a46b-3ecc80f7b8db tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:43.229473 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6c274c50-5e5b-433e-a46b-3ecc80f7b8db tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1218 microversion: 2.1 time: 0.089454 May 26 13:56:43.230054 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 54/99] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:43 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:43.321843 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4dc9fa4e-9323-4d21-a7bd-f79a9c2c0a24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:43.322478 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4dc9fa4e-9323-4d21-a7bd-f79a9c2c0a24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:43.329958 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4dc9fa4e-9323-4d21-a7bd-f79a9c2c0a24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:43.330407 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4dc9fa4e-9323-4d21-a7bd-f79a9c2c0a24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:43.331178 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4dc9fa4e-9323-4d21-a7bd-f79a9c2c0a24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:43.331596 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4dc9fa4e-9323-4d21-a7bd-f79a9c2c0a24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:43.468169 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d4cc9b7c-61bd-4bea-a3e1-f85a88323635 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:43.468792 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d4cc9b7c-61bd-4bea-a3e1-f85a88323635 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:43.476144 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d4cc9b7c-61bd-4bea-a3e1-f85a88323635 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:43.476905 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d4cc9b7c-61bd-4bea-a3e1-f85a88323635 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:43.478203 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d4cc9b7c-61bd-4bea-a3e1-f85a88323635 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:43.478660 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d4cc9b7c-61bd-4bea-a3e1-f85a88323635 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:43.480413 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4dc9fa4e-9323-4d21-a7bd-f79a9c2c0a24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:43.491062 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4dc9fa4e-9323-4d21-a7bd-f79a9c2c0a24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.172793 May 26 13:56:43.492332 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 46/100] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:43 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:43.631045 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d4cc9b7c-61bd-4bea-a3e1-f85a88323635 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:43.638306 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d4cc9b7c-61bd-4bea-a3e1-f85a88323635 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.174855 May 26 13:56:43.638884 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 55/101] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:43 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:56:43.915530 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ede03236-9cd4-48cb-be6e-4e38d15579f2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:43.916137 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ede03236-9cd4-48cb-be6e-4e38d15579f2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:43.922596 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ede03236-9cd4-48cb-be6e-4e38d15579f2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:43.923038 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ede03236-9cd4-48cb-be6e-4e38d15579f2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:43.923789 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ede03236-9cd4-48cb-be6e-4e38d15579f2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:43.924215 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ede03236-9cd4-48cb-be6e-4e38d15579f2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:43.934496 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0932ab1b-12ae-45ae-a4c3-73fbc35a54c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:43.935092 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0932ab1b-12ae-45ae-a4c3-73fbc35a54c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:43.941570 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0932ab1b-12ae-45ae-a4c3-73fbc35a54c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:43.942227 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0932ab1b-12ae-45ae-a4c3-73fbc35a54c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:43.942986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0932ab1b-12ae-45ae-a4c3-73fbc35a54c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:43.943413 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0932ab1b-12ae-45ae-a4c3-73fbc35a54c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:44.138370 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ede03236-9cd4-48cb-be6e-4e38d15579f2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:44.141470 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:44.144124 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0932ab1b-12ae-45ae-a4c3-73fbc35a54c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:44.149365 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ede03236-9cd4-48cb-be6e-4e38d15579f2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1367 microversion: 2.1 time: 0.237473 May 26 13:56:44.149947 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 47/102] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:43 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:44.157459 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0932ab1b-12ae-45ae-a4c3-73fbc35a54c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:44.159234 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0932ab1b-12ae-45ae-a4c3-73fbc35a54c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:44.160416 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0932ab1b-12ae-45ae-a4c3-73fbc35a54c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.229754 May 26 13:56:44.161210 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 56/103] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:43 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:56:44.246759 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-64aa2993-5da8-4cbf-90ab-d0075a354885 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:44.247361 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-64aa2993-5da8-4cbf-90ab-d0075a354885 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:44.253633 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-64aa2993-5da8-4cbf-90ab-d0075a354885 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:44.254084 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-64aa2993-5da8-4cbf-90ab-d0075a354885 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:44.254853 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-64aa2993-5da8-4cbf-90ab-d0075a354885 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:44.255285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-64aa2993-5da8-4cbf-90ab-d0075a354885 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:44.323023 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-64aa2993-5da8-4cbf-90ab-d0075a354885 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:44.339170 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-64aa2993-5da8-4cbf-90ab-d0075a354885 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1218 microversion: 2.1 time: 0.089692 May 26 13:56:44.339170 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 48/104] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:44 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:44.507801 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-61d1abe6-4b1d-4c46-889d-4dfff6690854 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:44.508513 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-61d1abe6-4b1d-4c46-889d-4dfff6690854 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:44.516395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-61d1abe6-4b1d-4c46-889d-4dfff6690854 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:44.516849 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-61d1abe6-4b1d-4c46-889d-4dfff6690854 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:44.517644 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-61d1abe6-4b1d-4c46-889d-4dfff6690854 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:44.518078 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-61d1abe6-4b1d-4c46-889d-4dfff6690854 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:44.656383 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2b8dbe2e-1310-44ee-8f84-3d90940db4dd tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:44.657054 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2b8dbe2e-1310-44ee-8f84-3d90940db4dd tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:44.665417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-61d1abe6-4b1d-4c46-889d-4dfff6690854 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:44.666208 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2b8dbe2e-1310-44ee-8f84-3d90940db4dd tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:44.666669 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2b8dbe2e-1310-44ee-8f84-3d90940db4dd tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:44.667553 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2b8dbe2e-1310-44ee-8f84-3d90940db4dd tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:44.667848 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2b8dbe2e-1310-44ee-8f84-3d90940db4dd tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:44.674089 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-61d1abe6-4b1d-4c46-889d-4dfff6690854 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.170186 May 26 13:56:44.674743 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 57/105] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:44 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:44.809645 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2b8dbe2e-1310-44ee-8f84-3d90940db4dd tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:44.817992 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2b8dbe2e-1310-44ee-8f84-3d90940db4dd tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.165621 May 26 13:56:44.819065 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 49/106] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:44 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:45.166728 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f860d3b9-8ad6-4431-bf7b-d01a3b72130d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:45.167467 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f860d3b9-8ad6-4431-bf7b-d01a3b72130d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:45.177341 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f860d3b9-8ad6-4431-bf7b-d01a3b72130d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:45.178017 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f860d3b9-8ad6-4431-bf7b-d01a3b72130d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:45.179591 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f860d3b9-8ad6-4431-bf7b-d01a3b72130d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:45.180565 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f860d3b9-8ad6-4431-bf7b-d01a3b72130d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:45.184750 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-83e1000d-480b-4948-a98c-7e28e76be2da tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:45.185419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-83e1000d-480b-4948-a98c-7e28e76be2da tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:45.197604 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-83e1000d-480b-4948-a98c-7e28e76be2da tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:45.198066 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-83e1000d-480b-4948-a98c-7e28e76be2da tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:45.198851 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-83e1000d-480b-4948-a98c-7e28e76be2da tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:45.199291 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-83e1000d-480b-4948-a98c-7e28e76be2da tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:45.378054 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f860d3b9-8ad6-4431-bf7b-d01a3b72130d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:45.386857 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f860d3b9-8ad6-4431-bf7b-d01a3b72130d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1367 microversion: 2.1 time: 0.223850 May 26 13:56:45.387623 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 58/107] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:45 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:45.391784 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-83e1000d-480b-4948-a98c-7e28e76be2da tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:45.402561 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-83e1000d-480b-4948-a98c-7e28e76be2da tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:45.404601 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-83e1000d-480b-4948-a98c-7e28e76be2da tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:45.406255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-83e1000d-480b-4948-a98c-7e28e76be2da tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.231206 May 26 13:56:45.406826 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 50/108] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:45 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:56:45.409832 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-963454f3-72aa-469d-bef2-c49098404627 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:45.410707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-963454f3-72aa-469d-bef2-c49098404627 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:45.417178 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-963454f3-72aa-469d-bef2-c49098404627 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:45.417645 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-963454f3-72aa-469d-bef2-c49098404627 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:45.418517 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-963454f3-72aa-469d-bef2-c49098404627 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:45.419007 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-963454f3-72aa-469d-bef2-c49098404627 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:45.498297 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-963454f3-72aa-469d-bef2-c49098404627 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:45.505704 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-963454f3-72aa-469d-bef2-c49098404627 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1218 microversion: 2.1 time: 0.104014 May 26 13:56:45.506601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 59/109] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:45 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1218 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:45.690582 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5e2a99ce-6dd8-474e-956f-fff10c2d75f0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:45.691257 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5e2a99ce-6dd8-474e-956f-fff10c2d75f0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:45.697086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5e2a99ce-6dd8-474e-956f-fff10c2d75f0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:45.697564 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5e2a99ce-6dd8-474e-956f-fff10c2d75f0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:45.698320 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5e2a99ce-6dd8-474e-956f-fff10c2d75f0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:45.698752 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5e2a99ce-6dd8-474e-956f-fff10c2d75f0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:45.833102 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5e2a99ce-6dd8-474e-956f-fff10c2d75f0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:45.836857 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-690af0e6-06bc-4348-a470-544c69e593f9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:45.837835 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-690af0e6-06bc-4348-a470-544c69e593f9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:45.846961 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5e2a99ce-6dd8-474e-956f-fff10c2d75f0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.160065 May 26 13:56:45.848096 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-690af0e6-06bc-4348-a470-544c69e593f9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:45.848612 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-690af0e6-06bc-4348-a470-544c69e593f9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:45.849581 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-690af0e6-06bc-4348-a470-544c69e593f9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:45.850199 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-690af0e6-06bc-4348-a470-544c69e593f9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:45.856261 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 51/110] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:45 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:46.025237 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-690af0e6-06bc-4348-a470-544c69e593f9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:46.032902 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-690af0e6-06bc-4348-a470-544c69e593f9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.200516 May 26 13:56:46.033627 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 60/111] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:45 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:56:46.404011 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a8e15485-7bca-4013-bd2e-5c5ef01b357a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:46.404610 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a8e15485-7bca-4013-bd2e-5c5ef01b357a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:46.410632 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a8e15485-7bca-4013-bd2e-5c5ef01b357a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:46.411111 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a8e15485-7bca-4013-bd2e-5c5ef01b357a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:46.411818 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a8e15485-7bca-4013-bd2e-5c5ef01b357a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:46.412246 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a8e15485-7bca-4013-bd2e-5c5ef01b357a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:46.424573 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ac16c026-4ee6-4bb7-a52e-0f6145376fc5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:46.425400 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ac16c026-4ee6-4bb7-a52e-0f6145376fc5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:46.431325 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac16c026-4ee6-4bb7-a52e-0f6145376fc5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:46.431792 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac16c026-4ee6-4bb7-a52e-0f6145376fc5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:46.432540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac16c026-4ee6-4bb7-a52e-0f6145376fc5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:46.432972 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac16c026-4ee6-4bb7-a52e-0f6145376fc5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:46.632144 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ac16c026-4ee6-4bb7-a52e-0f6145376fc5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:46.635004 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a8e15485-7bca-4013-bd2e-5c5ef01b357a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:46.641259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ac16c026-4ee6-4bb7-a52e-0f6145376fc5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:46.642524 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a8e15485-7bca-4013-bd2e-5c5ef01b357a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1367 microversion: 2.1 time: 0.242561 May 26 13:56:46.643092 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 52/112] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:46 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:46.643226 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ac16c026-4ee6-4bb7-a52e-0f6145376fc5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:46.644357 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ac16c026-4ee6-4bb7-a52e-0f6145376fc5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.224531 May 26 13:56:46.645084 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 61/113] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:46 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:56:46.647740 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6107db84-daa5-444f-a708-fc2f583ed16e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:46.648622 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6107db84-daa5-444f-a708-fc2f583ed16e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:46.655974 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6107db84-daa5-444f-a708-fc2f583ed16e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:46.656465 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6107db84-daa5-444f-a708-fc2f583ed16e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:46.657176 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6107db84-daa5-444f-a708-fc2f583ed16e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:46.657608 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6107db84-daa5-444f-a708-fc2f583ed16e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:46.726473 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6107db84-daa5-444f-a708-fc2f583ed16e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:46.735315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6107db84-daa5-444f-a708-fc2f583ed16e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1218 microversion: 2.1 time: 0.090973 May 26 13:56:46.735964 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 53/114] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:46 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:46.863258 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-49df6870-7c85-4626-8f3f-243692afefc8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:46.863863 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-49df6870-7c85-4626-8f3f-243692afefc8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:46.869769 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-49df6870-7c85-4626-8f3f-243692afefc8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:46.870213 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-49df6870-7c85-4626-8f3f-243692afefc8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:46.871197 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-49df6870-7c85-4626-8f3f-243692afefc8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:46.871761 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-49df6870-7c85-4626-8f3f-243692afefc8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:47.051865 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1b985c29-c393-4458-a618-996d2c74b983 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:47.052477 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1b985c29-c393-4458-a618-996d2c74b983 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:47.060133 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1b985c29-c393-4458-a618-996d2c74b983 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:47.060581 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1b985c29-c393-4458-a618-996d2c74b983 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:47.061498 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1b985c29-c393-4458-a618-996d2c74b983 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:47.061934 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1b985c29-c393-4458-a618-996d2c74b983 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:47.235938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-49df6870-7c85-4626-8f3f-243692afefc8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:47.244273 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-49df6870-7c85-4626-8f3f-243692afefc8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.384680 May 26 13:56:47.244934 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 62/115] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:46 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:47.259529 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1b985c29-c393-4458-a618-996d2c74b983 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:47.268501 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1b985c29-c393-4458-a618-996d2c74b983 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.221709 May 26 13:56:47.269181 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 54/116] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:47 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:47.659424 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1b7a4527-0591-486c-a03d-b9f90818ec67 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:47.660034 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1b7a4527-0591-486c-a03d-b9f90818ec67 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:47.662065 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cadbf432-569c-4e0b-98e6-70fcaabc0442 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:47.662666 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cadbf432-569c-4e0b-98e6-70fcaabc0442 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:47.666986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1b7a4527-0591-486c-a03d-b9f90818ec67 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:47.667519 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1b7a4527-0591-486c-a03d-b9f90818ec67 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:47.668357 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1b7a4527-0591-486c-a03d-b9f90818ec67 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:47.668864 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1b7a4527-0591-486c-a03d-b9f90818ec67 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:47.669326 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cadbf432-569c-4e0b-98e6-70fcaabc0442 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:47.669760 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cadbf432-569c-4e0b-98e6-70fcaabc0442 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:47.670588 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cadbf432-569c-4e0b-98e6-70fcaabc0442 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:47.671021 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cadbf432-569c-4e0b-98e6-70fcaabc0442 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:47.871815 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cadbf432-569c-4e0b-98e6-70fcaabc0442 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:47.875195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1b7a4527-0591-486c-a03d-b9f90818ec67 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:47.882709 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1b7a4527-0591-486c-a03d-b9f90818ec67 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1367 microversion: 2.1 time: 0.227068 May 26 13:56:47.882897 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cadbf432-569c-4e0b-98e6-70fcaabc0442 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:47.883283 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 63/117] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:47 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:47.893345 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-163206ca-f8f8-422f-8f85-ebd7bc867150 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:47.893345 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-163206ca-f8f8-422f-8f85-ebd7bc867150 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:47.895738 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-163206ca-f8f8-422f-8f85-ebd7bc867150 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:47.896673 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-163206ca-f8f8-422f-8f85-ebd7bc867150 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:47.897476 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-163206ca-f8f8-422f-8f85-ebd7bc867150 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:47.897911 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-163206ca-f8f8-422f-8f85-ebd7bc867150 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:47.899388 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cadbf432-569c-4e0b-98e6-70fcaabc0442 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:47.900608 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cadbf432-569c-4e0b-98e6-70fcaabc0442 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.242397 May 26 13:56:47.901436 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 55/118] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:47 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:56:47.962890 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-163206ca-f8f8-422f-8f85-ebd7bc867150 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:47.970253 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-163206ca-f8f8-422f-8f85-ebd7bc867150 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1218 microversion: 2.1 time: 0.086042 May 26 13:56:47.970814 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 64/119] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:47 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:48.260318 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8af01d7e-d14d-4ca2-8af6-7210a22bb0d8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:48.260954 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8af01d7e-d14d-4ca2-8af6-7210a22bb0d8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:48.267042 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8af01d7e-d14d-4ca2-8af6-7210a22bb0d8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:48.267484 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8af01d7e-d14d-4ca2-8af6-7210a22bb0d8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:48.268247 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8af01d7e-d14d-4ca2-8af6-7210a22bb0d8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:48.268685 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8af01d7e-d14d-4ca2-8af6-7210a22bb0d8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:48.286260 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-23bd0df6-4a4a-4b5b-9248-aa35ff95e71d tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:48.286854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-23bd0df6-4a4a-4b5b-9248-aa35ff95e71d tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:48.293355 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-23bd0df6-4a4a-4b5b-9248-aa35ff95e71d tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:48.293804 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-23bd0df6-4a4a-4b5b-9248-aa35ff95e71d tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:48.294558 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-23bd0df6-4a4a-4b5b-9248-aa35ff95e71d tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:48.294982 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-23bd0df6-4a4a-4b5b-9248-aa35ff95e71d tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:48.459847 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8af01d7e-d14d-4ca2-8af6-7210a22bb0d8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:48.463065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-23bd0df6-4a4a-4b5b-9248-aa35ff95e71d tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:48.467884 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8af01d7e-d14d-4ca2-8af6-7210a22bb0d8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.210858 May 26 13:56:48.468456 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 56/120] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:48 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:48.471105 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-23bd0df6-4a4a-4b5b-9248-aa35ff95e71d tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.188603 May 26 13:56:48.471670 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 65/121] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:48 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:56:48.851714 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-2540b28e-a33c-4854-8521-7fbf03a8f5e7 req-e4195cf5-e883-4ce6-aaee-d552f1ea9f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8503557-47d9-4fc4-ad98-e698f675e2ce", "name": "network-vif-plugged", "status": "completed", "tag": "f8d0143b-9f68-4c1b-a919-a3a667b7d168"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:48.859788 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-2540b28e-a33c-4854-8521-7fbf03a8f5e7 req-e4195cf5-e883-4ce6-aaee-d552f1ea9f24 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:48.860228 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-2540b28e-a33c-4854-8521-7fbf03a8f5e7 req-e4195cf5-e883-4ce6-aaee-d552f1ea9f24 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:48.870822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-2540b28e-a33c-4854-8521-7fbf03a8f5e7 req-e4195cf5-e883-4ce6-aaee-d552f1ea9f24 service nova] Creating event network-vif-plugged:f8d0143b-9f68-4c1b-a919-a3a667b7d168 for instance a8503557-47d9-4fc4-ad98-e698f675e2ce on hv-cinder-84213 May 26 13:56:48.875952 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-2540b28e-a33c-4854-8521-7fbf03a8f5e7 req-e4195cf5-e883-4ce6-aaee-d552f1ea9f24 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080662 May 26 13:56:48.876517 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 57/122] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 13:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:56:48.898822 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-dd686bf0-12e9-4bcd-9c68-64d8a15b9f96 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:48.899426 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-dd686bf0-12e9-4bcd-9c68-64d8a15b9f96 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:48.906571 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd686bf0-12e9-4bcd-9c68-64d8a15b9f96 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:48.907020 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd686bf0-12e9-4bcd-9c68-64d8a15b9f96 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:48.907770 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd686bf0-12e9-4bcd-9c68-64d8a15b9f96 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:48.908438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd686bf0-12e9-4bcd-9c68-64d8a15b9f96 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:48.918759 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f10760fe-160c-46ff-92ff-d0f9500331f9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:48.919469 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f10760fe-160c-46ff-92ff-d0f9500331f9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:48.925929 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f10760fe-160c-46ff-92ff-d0f9500331f9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:48.926385 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f10760fe-160c-46ff-92ff-d0f9500331f9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:48.927161 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f10760fe-160c-46ff-92ff-d0f9500331f9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:48.927596 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f10760fe-160c-46ff-92ff-d0f9500331f9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:49.112739 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-dd686bf0-12e9-4bcd-9c68-64d8a15b9f96 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:49.119237 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f10760fe-160c-46ff-92ff-d0f9500331f9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:49.125856 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-dd686bf0-12e9-4bcd-9c68-64d8a15b9f96 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1367 microversion: 2.1 time: 0.230706 May 26 13:56:49.128981 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 66/123] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:48 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:49.134275 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3a4cd3d1-3342-41ed-bf32-6e03d9fb9517 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:49.134882 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3a4cd3d1-3342-41ed-bf32-6e03d9fb9517 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:49.135917 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f10760fe-160c-46ff-92ff-d0f9500331f9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:49.138024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f10760fe-160c-46ff-92ff-d0f9500331f9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:49.139986 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f10760fe-160c-46ff-92ff-d0f9500331f9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.224840 May 26 13:56:49.140700 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 58/124] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:48 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:56:49.141527 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3a4cd3d1-3342-41ed-bf32-6e03d9fb9517 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:49.142140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3a4cd3d1-3342-41ed-bf32-6e03d9fb9517 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:49.143064 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3a4cd3d1-3342-41ed-bf32-6e03d9fb9517 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:49.143653 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3a4cd3d1-3342-41ed-bf32-6e03d9fb9517 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:49.212575 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3a4cd3d1-3342-41ed-bf32-6e03d9fb9517 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:49.220730 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3a4cd3d1-3342-41ed-bf32-6e03d9fb9517 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1218 microversion: 2.1 time: 0.090592 May 26 13:56:49.221330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 67/125] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:49 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:49.484779 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-49a31154-f8e2-4f23-9fe6-6fa743d09796 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:49.485334 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-49a31154-f8e2-4f23-9fe6-6fa743d09796 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:49.487420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c6d20e72-dd3f-4e50-a684-a8df7687150d tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:49.488023 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c6d20e72-dd3f-4e50-a684-a8df7687150d tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:49.491510 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-49a31154-f8e2-4f23-9fe6-6fa743d09796 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:49.491955 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-49a31154-f8e2-4f23-9fe6-6fa743d09796 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:49.492712 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-49a31154-f8e2-4f23-9fe6-6fa743d09796 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:49.493142 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-49a31154-f8e2-4f23-9fe6-6fa743d09796 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:49.494000 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c6d20e72-dd3f-4e50-a684-a8df7687150d tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:49.494447 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c6d20e72-dd3f-4e50-a684-a8df7687150d tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:49.495212 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c6d20e72-dd3f-4e50-a684-a8df7687150d tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:49.495954 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c6d20e72-dd3f-4e50-a684-a8df7687150d tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:49.691289 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c6d20e72-dd3f-4e50-a684-a8df7687150d tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:49.692597 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-49a31154-f8e2-4f23-9fe6-6fa743d09796 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:49.695474 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:49.701784 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-49a31154-f8e2-4f23-9fe6-6fa743d09796 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.220768 May 26 13:56:49.702125 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c6d20e72-dd3f-4e50-a684-a8df7687150d tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.217908 May 26 13:56:49.711704 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 59/126] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:49 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:49.712018 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 68/127] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:49 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:56:50.145202 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b945488e-5f55-4c11-8be7-067a48b17f18 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:50.145749 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b945488e-5f55-4c11-8be7-067a48b17f18 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:50.151857 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b945488e-5f55-4c11-8be7-067a48b17f18 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:50.152564 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b945488e-5f55-4c11-8be7-067a48b17f18 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:50.153698 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b945488e-5f55-4c11-8be7-067a48b17f18 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:50.154139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b945488e-5f55-4c11-8be7-067a48b17f18 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:50.158212 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8889795e-3aa3-486b-9230-ca201e09856e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:50.158812 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8889795e-3aa3-486b-9230-ca201e09856e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:50.164664 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8889795e-3aa3-486b-9230-ca201e09856e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:50.165109 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8889795e-3aa3-486b-9230-ca201e09856e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:50.165885 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8889795e-3aa3-486b-9230-ca201e09856e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:50.166319 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8889795e-3aa3-486b-9230-ca201e09856e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:50.346838 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b945488e-5f55-4c11-8be7-067a48b17f18 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:50.353474 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8889795e-3aa3-486b-9230-ca201e09856e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:50.354148 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b945488e-5f55-4c11-8be7-067a48b17f18 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1367 microversion: 2.1 time: 0.212916 May 26 13:56:50.354711 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 60/128] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:50 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:50.359574 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d59eb7f4-4b7a-4fa5-b75f-b638eb4e0687 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:50.360366 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d59eb7f4-4b7a-4fa5-b75f-b638eb4e0687 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:50.362136 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8889795e-3aa3-486b-9230-ca201e09856e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:50.363731 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8889795e-3aa3-486b-9230-ca201e09856e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:50.364697 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8889795e-3aa3-486b-9230-ca201e09856e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.210943 May 26 13:56:50.365597 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 69/129] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:50 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:56:50.366041 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d59eb7f4-4b7a-4fa5-b75f-b638eb4e0687 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:50.366490 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d59eb7f4-4b7a-4fa5-b75f-b638eb4e0687 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:50.367250 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d59eb7f4-4b7a-4fa5-b75f-b638eb4e0687 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:50.367676 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d59eb7f4-4b7a-4fa5-b75f-b638eb4e0687 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:50.431317 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d59eb7f4-4b7a-4fa5-b75f-b638eb4e0687 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:50.439145 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d59eb7f4-4b7a-4fa5-b75f-b638eb4e0687 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1218 microversion: 2.1 time: 0.083442 May 26 13:56:50.439634 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 61/130] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:50 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:50.719130 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-aab317e8-720a-4e09-ae1d-ac111f004ee9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:50.719329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-681f0ca2-ca18-47c0-b0c7-85b30a67f698 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:50.719733 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-aab317e8-720a-4e09-ae1d-ac111f004ee9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:50.719841 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-681f0ca2-ca18-47c0-b0c7-85b30a67f698 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:50.725738 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aab317e8-720a-4e09-ae1d-ac111f004ee9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:50.725903 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-681f0ca2-ca18-47c0-b0c7-85b30a67f698 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:50.726189 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aab317e8-720a-4e09-ae1d-ac111f004ee9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:50.726298 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-681f0ca2-ca18-47c0-b0c7-85b30a67f698 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:50.726948 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aab317e8-720a-4e09-ae1d-ac111f004ee9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:50.727044 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-681f0ca2-ca18-47c0-b0c7-85b30a67f698 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:50.727382 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-681f0ca2-ca18-47c0-b0c7-85b30a67f698 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:50.727474 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aab317e8-720a-4e09-ae1d-ac111f004ee9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:50.821818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=4 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:50.914359 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-aab317e8-720a-4e09-ae1d-ac111f004ee9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:50.921948 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-aab317e8-720a-4e09-ae1d-ac111f004ee9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.207102 May 26 13:56:50.922616 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 70/131] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:50 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:50.928494 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-681f0ca2-ca18-47c0-b0c7-85b30a67f698 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:50.935781 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-681f0ca2-ca18-47c0-b0c7-85b30a67f698 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.220936 May 26 13:56:50.936331 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 62/132] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:50 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:51.371398 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-17db3833-793b-4470-bb7c-7c14f5fc1446 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:51.372001 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-17db3833-793b-4470-bb7c-7c14f5fc1446 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:51.374404 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=8 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:51.380014 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-17db3833-793b-4470-bb7c-7c14f5fc1446 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:51.380463 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-17db3833-793b-4470-bb7c-7c14f5fc1446 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:51.381248 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-17db3833-793b-4470-bb7c-7c14f5fc1446 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:51.381684 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-17db3833-793b-4470-bb7c-7c14f5fc1446 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:51.382682 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ec8e41c9-d3b0-4ad9-a5c1-116521f28ae4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:51.383293 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ec8e41c9-d3b0-4ad9-a5c1-116521f28ae4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:51.390481 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ec8e41c9-d3b0-4ad9-a5c1-116521f28ae4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:51.391512 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ec8e41c9-d3b0-4ad9-a5c1-116521f28ae4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:51.404005 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ec8e41c9-d3b0-4ad9-a5c1-116521f28ae4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:51.404660 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ec8e41c9-d3b0-4ad9-a5c1-116521f28ae4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:51.610196 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-17db3833-793b-4470-bb7c-7c14f5fc1446 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:51.613633 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ec8e41c9-d3b0-4ad9-a5c1-116521f28ae4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:51.618119 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-17db3833-793b-4470-bb7c-7c14f5fc1446 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1367 microversion: 2.1 time: 0.250362 May 26 13:56:51.629696 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 71/133] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:51 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:51.636201 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6b6029c0-701a-41ef-8d01-beca89d2fb54 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:51.636358 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ec8e41c9-d3b0-4ad9-a5c1-116521f28ae4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:51.637131 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6b6029c0-701a-41ef-8d01-beca89d2fb54 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:51.638191 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ec8e41c9-d3b0-4ad9-a5c1-116521f28ae4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:51.639340 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ec8e41c9-d3b0-4ad9-a5c1-116521f28ae4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.260413 May 26 13:56:51.640166 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 63/134] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:51 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:56:51.644088 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6b6029c0-701a-41ef-8d01-beca89d2fb54 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:51.644689 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6b6029c0-701a-41ef-8d01-beca89d2fb54 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:51.645617 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6b6029c0-701a-41ef-8d01-beca89d2fb54 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:51.646216 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6b6029c0-701a-41ef-8d01-beca89d2fb54 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:51.715646 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6b6029c0-701a-41ef-8d01-beca89d2fb54 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:51.723029 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6b6029c0-701a-41ef-8d01-beca89d2fb54 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1218 microversion: 2.1 time: 0.090741 May 26 13:56:51.723601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 72/135] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:51 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:51.937972 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a3882b6a-bd62-414b-9544-2a0775246682 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:51.938572 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a3882b6a-bd62-414b-9544-2a0775246682 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:51.944616 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a3882b6a-bd62-414b-9544-2a0775246682 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:51.945143 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a3882b6a-bd62-414b-9544-2a0775246682 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:51.946078 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a3882b6a-bd62-414b-9544-2a0775246682 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:51.946687 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a3882b6a-bd62-414b-9544-2a0775246682 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:51.952358 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1699581c-9cac-4ee2-8a83-ddc8cec302ab tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:51.953280 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1699581c-9cac-4ee2-8a83-ddc8cec302ab tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:51.959960 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1699581c-9cac-4ee2-8a83-ddc8cec302ab tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:51.960658 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1699581c-9cac-4ee2-8a83-ddc8cec302ab tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:51.961653 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1699581c-9cac-4ee2-8a83-ddc8cec302ab tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:51.962235 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1699581c-9cac-4ee2-8a83-ddc8cec302ab tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:52.148647 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a3882b6a-bd62-414b-9544-2a0775246682 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:52.157641 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a3882b6a-bd62-414b-9544-2a0775246682 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.223333 May 26 13:56:52.158325 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 64/136] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:51 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:52.174465 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1699581c-9cac-4ee2-8a83-ddc8cec302ab tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:52.181885 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1699581c-9cac-4ee2-8a83-ddc8cec302ab tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.233561 May 26 13:56:52.182452 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 73/137] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:51 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:52.635899 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a07a0d14-c2d6-4a48-910c-3d9ffbb4f784 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:52.636518 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a07a0d14-c2d6-4a48-910c-3d9ffbb4f784 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:52.642739 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a07a0d14-c2d6-4a48-910c-3d9ffbb4f784 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:52.643246 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a07a0d14-c2d6-4a48-910c-3d9ffbb4f784 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:52.644023 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a07a0d14-c2d6-4a48-910c-3d9ffbb4f784 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:52.644441 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a07a0d14-c2d6-4a48-910c-3d9ffbb4f784 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:52.648531 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:52.658891 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-104effa6-7454-48d0-a89e-acaf714de0c5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:52.659545 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-104effa6-7454-48d0-a89e-acaf714de0c5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:52.666019 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-104effa6-7454-48d0-a89e-acaf714de0c5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:52.666461 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-104effa6-7454-48d0-a89e-acaf714de0c5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:52.667361 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-104effa6-7454-48d0-a89e-acaf714de0c5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:52.667641 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-104effa6-7454-48d0-a89e-acaf714de0c5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:52.909383 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-104effa6-7454-48d0-a89e-acaf714de0c5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:52.912897 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a07a0d14-c2d6-4a48-910c-3d9ffbb4f784 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:52.922098 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-104effa6-7454-48d0-a89e-acaf714de0c5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:52.924932 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-104effa6-7454-48d0-a89e-acaf714de0c5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:52.926467 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-104effa6-7454-48d0-a89e-acaf714de0c5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.272115 May 26 13:56:52.927301 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 74/138] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:52 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:56:52.936146 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a07a0d14-c2d6-4a48-910c-3d9ffbb4f784 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1367 microversion: 2.1 time: 0.301682 May 26 13:56:52.937351 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 65/139] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:52 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1367 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:52.947407 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d5291de2-b244-45fa-b2df-465e085004cf tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:52.948113 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d5291de2-b244-45fa-b2df-465e085004cf tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:52.954837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:52.956587 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d5291de2-b244-45fa-b2df-465e085004cf tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:52.957034 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d5291de2-b244-45fa-b2df-465e085004cf tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:52.958010 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d5291de2-b244-45fa-b2df-465e085004cf tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:52.958309 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d5291de2-b244-45fa-b2df-465e085004cf tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:53.025177 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d5291de2-b244-45fa-b2df-465e085004cf tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:53.034025 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d5291de2-b244-45fa-b2df-465e085004cf tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1218 microversion: 2.1 time: 0.105249 May 26 13:56:53.034982 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 75/140] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:52 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:53.175537 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-84c61bc9-1929-4640-9955-9c9791e84d1b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:53.176451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-84c61bc9-1929-4640-9955-9c9791e84d1b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:53.182982 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-84c61bc9-1929-4640-9955-9c9791e84d1b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:53.183435 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-84c61bc9-1929-4640-9955-9c9791e84d1b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:53.184205 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-84c61bc9-1929-4640-9955-9c9791e84d1b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:53.184645 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-84c61bc9-1929-4640-9955-9c9791e84d1b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:53.204652 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-62fe8843-a8c1-427e-a227-3db3523dbaa4 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:53.205540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-62fe8843-a8c1-427e-a227-3db3523dbaa4 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:53.211982 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-62fe8843-a8c1-427e-a227-3db3523dbaa4 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:53.212438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-62fe8843-a8c1-427e-a227-3db3523dbaa4 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:53.213277 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-62fe8843-a8c1-427e-a227-3db3523dbaa4 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:53.213715 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-62fe8843-a8c1-427e-a227-3db3523dbaa4 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:53.384521 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-84c61bc9-1929-4640-9955-9c9791e84d1b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:53.393036 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-84c61bc9-1929-4640-9955-9c9791e84d1b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.221530 May 26 13:56:53.393641 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 66/141] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:53 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:53.395999 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-62fe8843-a8c1-427e-a227-3db3523dbaa4 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:53.404272 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-62fe8843-a8c1-427e-a227-3db3523dbaa4 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.209033 May 26 13:56:53.405573 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 76/142] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:53 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:56:53.943946 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b26dc1ec-73e7-4c15-801c-2b78e09815ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:53.944550 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b26dc1ec-73e7-4c15-801c-2b78e09815ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:53.951385 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b26dc1ec-73e7-4c15-801c-2b78e09815ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:53.951836 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b26dc1ec-73e7-4c15-801c-2b78e09815ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:53.952911 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b26dc1ec-73e7-4c15-801c-2b78e09815ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:53.953052 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b26dc1ec-73e7-4c15-801c-2b78e09815ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:53.956668 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a18eb62c-99d6-42a3-b514-811a62e5cf9c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:53.960184 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a18eb62c-99d6-42a3-b514-811a62e5cf9c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:53.973875 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a18eb62c-99d6-42a3-b514-811a62e5cf9c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:53.974469 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a18eb62c-99d6-42a3-b514-811a62e5cf9c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:53.975346 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a18eb62c-99d6-42a3-b514-811a62e5cf9c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:53.981775 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a18eb62c-99d6-42a3-b514-811a62e5cf9c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:54.218712 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a18eb62c-99d6-42a3-b514-811a62e5cf9c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:54.231857 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a18eb62c-99d6-42a3-b514-811a62e5cf9c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1367 microversion: 2.1 time: 0.283191 May 26 13:56:54.233439 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 77/143] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:53 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:56:54.245366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-647deec4-0810-44c0-b532-689632808fcf tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:54.249557 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-647deec4-0810-44c0-b532-689632808fcf tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:54.262472 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b26dc1ec-73e7-4c15-801c-2b78e09815ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:54.263128 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-647deec4-0810-44c0-b532-689632808fcf tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:54.265682 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-647deec4-0810-44c0-b532-689632808fcf tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:54.267553 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-647deec4-0810-44c0-b532-689632808fcf tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:54.271473 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-647deec4-0810-44c0-b532-689632808fcf tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:54.273402 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b26dc1ec-73e7-4c15-801c-2b78e09815ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:54.275673 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b26dc1ec-73e7-4c15-801c-2b78e09815ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:54.277001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b26dc1ec-73e7-4c15-801c-2b78e09815ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.337098 May 26 13:56:54.278279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 67/144] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:53 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:56:54.380590 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-647deec4-0810-44c0-b532-689632808fcf tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:54.391870 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-647deec4-0810-44c0-b532-689632808fcf tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1218 microversion: 2.1 time: 0.155002 May 26 13:56:54.392952 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 78/145] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:54 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1218 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:54.410238 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5866376f-7be9-44d7-852c-9677638a392d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:54.410931 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5866376f-7be9-44d7-852c-9677638a392d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:54.417363 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5866376f-7be9-44d7-852c-9677638a392d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:54.418064 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5866376f-7be9-44d7-852c-9677638a392d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:54.419456 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5866376f-7be9-44d7-852c-9677638a392d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:54.420172 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5866376f-7be9-44d7-852c-9677638a392d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:54.424483 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a0e7e3b6-7c8e-4c79-83bb-744f5169eb88 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:54.426150 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a0e7e3b6-7c8e-4c79-83bb-744f5169eb88 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:54.442369 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a0e7e3b6-7c8e-4c79-83bb-744f5169eb88 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:54.442831 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a0e7e3b6-7c8e-4c79-83bb-744f5169eb88 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:54.444688 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a0e7e3b6-7c8e-4c79-83bb-744f5169eb88 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:54.445373 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a0e7e3b6-7c8e-4c79-83bb-744f5169eb88 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:54.670922 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5866376f-7be9-44d7-852c-9677638a392d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:54.678224 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5866376f-7be9-44d7-852c-9677638a392d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.271830 May 26 13:56:54.687549 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 68/146] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:54 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:54.710419 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a0e7e3b6-7c8e-4c79-83bb-744f5169eb88 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:54.718822 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a0e7e3b6-7c8e-4c79-83bb-744f5169eb88 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.298716 May 26 13:56:54.719315 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 79/147] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:54 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:56:55.251392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-893b6361-5f4b-4a37-8a17-61b289499d13 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:55.252241 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-893b6361-5f4b-4a37-8a17-61b289499d13 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:55.259076 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-893b6361-5f4b-4a37-8a17-61b289499d13 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:55.259732 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-893b6361-5f4b-4a37-8a17-61b289499d13 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:55.260835 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-893b6361-5f4b-4a37-8a17-61b289499d13 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:55.261445 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-893b6361-5f4b-4a37-8a17-61b289499d13 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:55.296474 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2f43cd6d-b65c-436f-a76f-205d8f9642ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:55.297082 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2f43cd6d-b65c-436f-a76f-205d8f9642ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:55.303927 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2f43cd6d-b65c-436f-a76f-205d8f9642ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:55.304373 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2f43cd6d-b65c-436f-a76f-205d8f9642ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:55.305427 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2f43cd6d-b65c-436f-a76f-205d8f9642ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:55.306325 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2f43cd6d-b65c-436f-a76f-205d8f9642ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:55.469204 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-893b6361-5f4b-4a37-8a17-61b289499d13 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:55.477454 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-893b6361-5f4b-4a37-8a17-61b289499d13 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1367 microversion: 2.1 time: 0.231813 May 26 13:56:55.478026 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 69/148] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:55 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:55.493217 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-9e780b4b-7c50-48b9-a5fe-2b009acbafb1 req-d150b98c-0ee3-4a3a-bd74-c1fee6197563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71af8283-a8f5-44e7-bdcd-6606070472b2", "name": "network-vif-plugged", "status": "completed", "tag": "44b52c9b-2e5c-490a-ab42-cd30ca4bea28"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:55.514968 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-9e780b4b-7c50-48b9-a5fe-2b009acbafb1 req-d150b98c-0ee3-4a3a-bd74-c1fee6197563 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:55.515501 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-9e780b4b-7c50-48b9-a5fe-2b009acbafb1 req-d150b98c-0ee3-4a3a-bd74-c1fee6197563 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:55.528089 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-9e780b4b-7c50-48b9-a5fe-2b009acbafb1 req-d150b98c-0ee3-4a3a-bd74-c1fee6197563 service nova] Creating event network-vif-plugged:44b52c9b-2e5c-490a-ab42-cd30ca4bea28 for instance 71af8283-a8f5-44e7-bdcd-6606070472b2 on hv-cinder-84213 May 26 13:56:55.535880 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-9e780b4b-7c50-48b9-a5fe-2b009acbafb1 req-d150b98c-0ee3-4a3a-bd74-c1fee6197563 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053734 May 26 13:56:55.537122 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 70/149] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 13:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:56:55.542644 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7e8bd838-4cc2-45af-b84c-634c26e42b32 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:55.543343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7e8bd838-4cc2-45af-b84c-634c26e42b32 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:55.550163 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7e8bd838-4cc2-45af-b84c-634c26e42b32 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:55.550867 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7e8bd838-4cc2-45af-b84c-634c26e42b32 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:55.551786 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7e8bd838-4cc2-45af-b84c-634c26e42b32 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:55.552373 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7e8bd838-4cc2-45af-b84c-634c26e42b32 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:55.577710 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2f43cd6d-b65c-436f-a76f-205d8f9642ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:55.591563 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2f43cd6d-b65c-436f-a76f-205d8f9642ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:55.593879 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2f43cd6d-b65c-436f-a76f-205d8f9642ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:55.595026 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2f43cd6d-b65c-436f-a76f-205d8f9642ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.303020 May 26 13:56:55.595584 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 80/150] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:55 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:56:55.620344 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7e8bd838-4cc2-45af-b84c-634c26e42b32 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:55.628166 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7e8bd838-4cc2-45af-b84c-634c26e42b32 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1218 microversion: 2.1 time: 0.089708 May 26 13:56:55.628742 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 71/151] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:55 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:55.695717 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6ff5ceba-6240-4adc-a1af-2ac9f87fac90 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:55.696388 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6ff5ceba-6240-4adc-a1af-2ac9f87fac90 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:55.713180 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6ff5ceba-6240-4adc-a1af-2ac9f87fac90 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:55.714880 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6ff5ceba-6240-4adc-a1af-2ac9f87fac90 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:55.717707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6ff5ceba-6240-4adc-a1af-2ac9f87fac90 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:55.719469 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6ff5ceba-6240-4adc-a1af-2ac9f87fac90 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:55.742556 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c615c38b-4c49-4a9d-8af5-0f17eb483384 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:55.744006 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c615c38b-4c49-4a9d-8af5-0f17eb483384 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:55.758966 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c615c38b-4c49-4a9d-8af5-0f17eb483384 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:55.760096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c615c38b-4c49-4a9d-8af5-0f17eb483384 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:55.764352 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c615c38b-4c49-4a9d-8af5-0f17eb483384 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:55.767178 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c615c38b-4c49-4a9d-8af5-0f17eb483384 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:56.519135 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6ff5ceba-6240-4adc-a1af-2ac9f87fac90 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:56.524418 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c615c38b-4c49-4a9d-8af5-0f17eb483384 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:56.527447 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6ff5ceba-6240-4adc-a1af-2ac9f87fac90 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.835816 May 26 13:56:56.528544 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 81/152] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:55 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:56.532498 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c615c38b-4c49-4a9d-8af5-0f17eb483384 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.798526 May 26 13:56:56.533176 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 72/153] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:55 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:56.549061 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b08969d1-b725-47a7-bfe2-106fc63a75d8 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:56.549716 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b08969d1-b725-47a7-bfe2-106fc63a75d8 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:56.556312 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b08969d1-b725-47a7-bfe2-106fc63a75d8 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:56.556766 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b08969d1-b725-47a7-bfe2-106fc63a75d8 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:56.557560 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b08969d1-b725-47a7-bfe2-106fc63a75d8 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:56.558001 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b08969d1-b725-47a7-bfe2-106fc63a75d8 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:56.612281 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b0b824ea-14cc-446d-bc5c-f10e5424efac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:56.613131 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b0b824ea-14cc-446d-bc5c-f10e5424efac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:56.619840 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b0b824ea-14cc-446d-bc5c-f10e5424efac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:56.620334 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b0b824ea-14cc-446d-bc5c-f10e5424efac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:56.621234 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b0b824ea-14cc-446d-bc5c-f10e5424efac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:56.621874 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b0b824ea-14cc-446d-bc5c-f10e5424efac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:56.748060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b08969d1-b725-47a7-bfe2-106fc63a75d8 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:56.768026 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b08969d1-b725-47a7-bfe2-106fc63a75d8 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1367 microversion: 2.1 time: 0.237272 May 26 13:56:56.778034 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 82/154] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:56 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:56.791032 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-702ab3fe-077c-46f5-92c5-9de3686e2216 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:56.791652 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-702ab3fe-077c-46f5-92c5-9de3686e2216 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:56.795847 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b0b824ea-14cc-446d-bc5c-f10e5424efac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:56.798977 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-702ab3fe-077c-46f5-92c5-9de3686e2216 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:56.799921 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-702ab3fe-077c-46f5-92c5-9de3686e2216 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:56.804330 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b0b824ea-14cc-446d-bc5c-f10e5424efac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:56.805867 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b0b824ea-14cc-446d-bc5c-f10e5424efac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:56.806966 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b0b824ea-14cc-446d-bc5c-f10e5424efac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.198619 May 26 13:56:56.807527 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 73/155] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:56 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:56:56.813067 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-702ab3fe-077c-46f5-92c5-9de3686e2216 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:56.813564 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-702ab3fe-077c-46f5-92c5-9de3686e2216 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:56.875478 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-702ab3fe-077c-46f5-92c5-9de3686e2216 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:56.883530 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-702ab3fe-077c-46f5-92c5-9de3686e2216 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1210 microversion: 2.1 time: 0.112122 May 26 13:56:56.884994 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 83/156] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:56 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1210 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:57.550729 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0caf9c49-a823-4e51-94f8-0612ce2f5be1 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:57.551827 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0caf9c49-a823-4e51-94f8-0612ce2f5be1 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:57.553793 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a3ebb60d-6289-448a-9809-7d710de6baa3 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:57.554439 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a3ebb60d-6289-448a-9809-7d710de6baa3 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:57.558902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0caf9c49-a823-4e51-94f8-0612ce2f5be1 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:57.559359 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0caf9c49-a823-4e51-94f8-0612ce2f5be1 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:57.560139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0caf9c49-a823-4e51-94f8-0612ce2f5be1 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:57.560614 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0caf9c49-a823-4e51-94f8-0612ce2f5be1 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:57.561445 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a3ebb60d-6289-448a-9809-7d710de6baa3 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:57.562275 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a3ebb60d-6289-448a-9809-7d710de6baa3 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:57.563052 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a3ebb60d-6289-448a-9809-7d710de6baa3 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:57.563802 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a3ebb60d-6289-448a-9809-7d710de6baa3 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:57.783013 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a3ebb60d-6289-448a-9809-7d710de6baa3 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:57.793606 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a3ebb60d-6289-448a-9809-7d710de6baa3 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.244794 May 26 13:56:57.795082 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 84/157] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:57 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:57.800188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0caf9c49-a823-4e51-94f8-0612ce2f5be1 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:57.807480 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0c79ebab-73ba-4133-8445-56f2d96e3bdd tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:57.808016 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0caf9c49-a823-4e51-94f8-0612ce2f5be1 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.261506 May 26 13:56:57.808128 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0c79ebab-73ba-4133-8445-56f2d96e3bdd tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:57.808585 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 74/158] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:57 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:57.814405 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0c79ebab-73ba-4133-8445-56f2d96e3bdd tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:57.815121 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0c79ebab-73ba-4133-8445-56f2d96e3bdd tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:57.815889 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0c79ebab-73ba-4133-8445-56f2d96e3bdd tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:57.816322 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0c79ebab-73ba-4133-8445-56f2d96e3bdd tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:57.831673 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-882789e6-8722-483b-a724-0ddb74dc30bb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:57.837396 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-882789e6-8722-483b-a724-0ddb74dc30bb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:57.841799 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:57.845139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=99 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:57.859344 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-882789e6-8722-483b-a724-0ddb74dc30bb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:57.859800 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-882789e6-8722-483b-a724-0ddb74dc30bb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:57.860606 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-882789e6-8722-483b-a724-0ddb74dc30bb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:57.861304 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-882789e6-8722-483b-a724-0ddb74dc30bb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:58.045056 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-882789e6-8722-483b-a724-0ddb74dc30bb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:58.058174 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0c79ebab-73ba-4133-8445-56f2d96e3bdd tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:58.062792 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-882789e6-8722-483b-a724-0ddb74dc30bb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:58.065136 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-882789e6-8722-483b-a724-0ddb74dc30bb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:58.066478 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-882789e6-8722-483b-a724-0ddb74dc30bb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.245499 May 26 13:56:58.067364 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 75/159] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:57 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:56:58.067951 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0c79ebab-73ba-4133-8445-56f2d96e3bdd tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1367 microversion: 2.1 time: 0.271170 May 26 13:56:58.068608 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 85/160] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:57 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:58.071945 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0ffab887-181b-4aa4-895d-665f698560f8 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:58.072584 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0ffab887-181b-4aa4-895d-665f698560f8 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:58.080215 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ffab887-181b-4aa4-895d-665f698560f8 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:58.081007 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ffab887-181b-4aa4-895d-665f698560f8 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:58.081968 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ffab887-181b-4aa4-895d-665f698560f8 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:58.082398 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ffab887-181b-4aa4-895d-665f698560f8 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:58.146524 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0ffab887-181b-4aa4-895d-665f698560f8 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:58.154500 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0ffab887-181b-4aa4-895d-665f698560f8 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1210 microversion: 2.1 time: 0.086095 May 26 13:56:58.163688 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 76/161] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:58 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:58.811460 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-86003a05-b629-4e47-a230-b246849682c0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:58.811973 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-86003a05-b629-4e47-a230-b246849682c0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:58.821755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-86003a05-b629-4e47-a230-b246849682c0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:58.822551 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-86003a05-b629-4e47-a230-b246849682c0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:58.824393 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-86003a05-b629-4e47-a230-b246849682c0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:58.825436 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6ba79d85-f7a7-4ce5-bfa5-a6442389d293 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:58.826236 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-86003a05-b629-4e47-a230-b246849682c0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:58.826884 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6ba79d85-f7a7-4ce5-bfa5-a6442389d293 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:58.833176 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6ba79d85-f7a7-4ce5-bfa5-a6442389d293 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:58.833638 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6ba79d85-f7a7-4ce5-bfa5-a6442389d293 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:58.834594 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6ba79d85-f7a7-4ce5-bfa5-a6442389d293 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:58.835214 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6ba79d85-f7a7-4ce5-bfa5-a6442389d293 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:59.273505 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6ba79d85-f7a7-4ce5-bfa5-a6442389d293 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:59.289087 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6ba79d85-f7a7-4ce5-bfa5-a6442389d293 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.464424 May 26 13:56:59.291190 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 77/162] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:58 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:59.298867 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-83d52826-5c5b-41c8-a4b8-269d03b8d2a1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:59.304388 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-83d52826-5c5b-41c8-a4b8-269d03b8d2a1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:59.328075 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-83d52826-5c5b-41c8-a4b8-269d03b8d2a1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:59.328290 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-86003a05-b629-4e47-a230-b246849682c0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:59.339278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-83d52826-5c5b-41c8-a4b8-269d03b8d2a1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:59.340218 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-83d52826-5c5b-41c8-a4b8-269d03b8d2a1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:59.340568 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-86003a05-b629-4e47-a230-b246849682c0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.532348 May 26 13:56:59.340830 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-83d52826-5c5b-41c8-a4b8-269d03b8d2a1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:59.342452 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 86/163] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:58 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:59.350305 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3acd08c9-af1f-4876-9093-2e3bd8748aaf tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:59.351243 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3acd08c9-af1f-4876-9093-2e3bd8748aaf tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:59.366575 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3acd08c9-af1f-4876-9093-2e3bd8748aaf tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:59.367985 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3acd08c9-af1f-4876-9093-2e3bd8748aaf tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:59.370040 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3acd08c9-af1f-4876-9093-2e3bd8748aaf tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:59.371877 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3acd08c9-af1f-4876-9093-2e3bd8748aaf tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:59.617302 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-83d52826-5c5b-41c8-a4b8-269d03b8d2a1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:59.629135 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3acd08c9-af1f-4876-9093-2e3bd8748aaf tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:59.634522 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-83d52826-5c5b-41c8-a4b8-269d03b8d2a1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:59.642949 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-83d52826-5c5b-41c8-a4b8-269d03b8d2a1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:59.644805 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-83d52826-5c5b-41c8-a4b8-269d03b8d2a1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.352169 May 26 13:56:59.645404 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 78/164] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:56:59 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:56:59.646779 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3acd08c9-af1f-4876-9093-2e3bd8748aaf tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1367 microversion: 2.1 time: 0.301535 May 26 13:56:59.649832 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 87/165] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:59 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:59.664411 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4cc7e67a-f218-40d9-adb0-819f72922e3a tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:59.665358 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4cc7e67a-f218-40d9-adb0-819f72922e3a tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:59.672634 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4cc7e67a-f218-40d9-adb0-819f72922e3a tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:59.673099 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4cc7e67a-f218-40d9-adb0-819f72922e3a tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:59.673933 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4cc7e67a-f218-40d9-adb0-819f72922e3a tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:59.674537 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4cc7e67a-f218-40d9-adb0-819f72922e3a tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:59.699775 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-ef23a355-a057-4644-af13-b0ae9ba7f80a req-058ca10f-8674-4c7d-ae71-47df9ce74672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b980b635-eece-4c60-9b6c-e18d32bdc7da", "name": "network-vif-plugged", "status": "completed", "tag": "d789974b-4593-46b6-9ee2-38b74839df10"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:59.722844 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-ef23a355-a057-4644-af13-b0ae9ba7f80a req-058ca10f-8674-4c7d-ae71-47df9ce74672 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:59.723290 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-ef23a355-a057-4644-af13-b0ae9ba7f80a req-058ca10f-8674-4c7d-ae71-47df9ce74672 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:59.749859 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-ef23a355-a057-4644-af13-b0ae9ba7f80a req-058ca10f-8674-4c7d-ae71-47df9ce74672 service nova] Creating event network-vif-plugged:d789974b-4593-46b6-9ee2-38b74839df10 for instance b980b635-eece-4c60-9b6c-e18d32bdc7da on hv-cinder-84213 May 26 13:56:59.766915 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-ef23a355-a057-4644-af13-b0ae9ba7f80a req-058ca10f-8674-4c7d-ae71-47df9ce74672 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070715 May 26 13:56:59.767526 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 88/166] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 13:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:56:59.809097 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4cc7e67a-f218-40d9-adb0-819f72922e3a tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:59.820312 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4cc7e67a-f218-40d9-adb0-819f72922e3a tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1274 microversion: 2.1 time: 0.171783 May 26 13:56:59.821000 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 79/167] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:56:59 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1274 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:00.307527 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-33241798-36cc-4d98-9abf-fdf0b598cb92 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:00.308095 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-33241798-36cc-4d98-9abf-fdf0b598cb92 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:00.324133 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-33241798-36cc-4d98-9abf-fdf0b598cb92 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:00.324605 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-33241798-36cc-4d98-9abf-fdf0b598cb92 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:00.325857 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-33241798-36cc-4d98-9abf-fdf0b598cb92 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:00.329468 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-33241798-36cc-4d98-9abf-fdf0b598cb92 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:00.365330 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f521e4e3-f271-4fb5-9f36-e503f8890169 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:00.365939 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f521e4e3-f271-4fb5-9f36-e503f8890169 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:00.381696 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f521e4e3-f271-4fb5-9f36-e503f8890169 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:00.382151 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f521e4e3-f271-4fb5-9f36-e503f8890169 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:00.384528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f521e4e3-f271-4fb5-9f36-e503f8890169 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:00.384982 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f521e4e3-f271-4fb5-9f36-e503f8890169 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:00.538722 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-33241798-36cc-4d98-9abf-fdf0b598cb92 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:00.548516 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-33241798-36cc-4d98-9abf-fdf0b598cb92 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.246199 May 26 13:57:00.549112 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 89/168] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:00 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:00.594390 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f521e4e3-f271-4fb5-9f36-e503f8890169 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:00.601711 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f521e4e3-f271-4fb5-9f36-e503f8890169 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.242259 May 26 13:57:00.602593 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 80/169] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:00 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:00.663241 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a6a764ad-9fba-4e49-b715-6481d79a909a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:00.664243 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a6a764ad-9fba-4e49-b715-6481d79a909a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:00.666157 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ae8cb2b0-2ebc-4114-9660-2c44ca1b9a18 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:00.667054 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ae8cb2b0-2ebc-4114-9660-2c44ca1b9a18 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:00.673506 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a6a764ad-9fba-4e49-b715-6481d79a909a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:00.674239 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a6a764ad-9fba-4e49-b715-6481d79a909a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:00.674376 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ae8cb2b0-2ebc-4114-9660-2c44ca1b9a18 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:00.674748 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ae8cb2b0-2ebc-4114-9660-2c44ca1b9a18 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:00.675522 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ae8cb2b0-2ebc-4114-9660-2c44ca1b9a18 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:00.675864 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a6a764ad-9fba-4e49-b715-6481d79a909a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:00.675976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ae8cb2b0-2ebc-4114-9660-2c44ca1b9a18 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:00.676531 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a6a764ad-9fba-4e49-b715-6481d79a909a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:00.874848 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ae8cb2b0-2ebc-4114-9660-2c44ca1b9a18 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:00.878469 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a6a764ad-9fba-4e49-b715-6481d79a909a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:00.884087 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ae8cb2b0-2ebc-4114-9660-2c44ca1b9a18 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1367 microversion: 2.1 time: 0.222222 May 26 13:57:00.884663 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 81/170] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:00 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:00.888020 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a6a764ad-9fba-4e49-b715-6481d79a909a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:00.888927 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a6a764ad-9fba-4e49-b715-6481d79a909a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:00.889072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b719eebe-1817-4188-8128-1ed766498669 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:00.889687 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b719eebe-1817-4188-8128-1ed766498669 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:00.890210 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a6a764ad-9fba-4e49-b715-6481d79a909a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.231066 May 26 13:57:00.890861 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 90/171] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:57:00 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:57:00.898119 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b719eebe-1817-4188-8128-1ed766498669 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:00.898752 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b719eebe-1817-4188-8128-1ed766498669 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:00.899662 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b719eebe-1817-4188-8128-1ed766498669 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:00.900239 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b719eebe-1817-4188-8128-1ed766498669 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:00.918619 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:00.986507 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b719eebe-1817-4188-8128-1ed766498669 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:00.996192 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b719eebe-1817-4188-8128-1ed766498669 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1284 microversion: 2.1 time: 0.110323 May 26 13:57:00.997817 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 82/172] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:00 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:01.565899 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5d095f9d-7e2b-4b2c-96e5-3cb42d30e79e tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:01.566497 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5d095f9d-7e2b-4b2c-96e5-3cb42d30e79e tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:01.574193 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5d095f9d-7e2b-4b2c-96e5-3cb42d30e79e tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:01.574633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5d095f9d-7e2b-4b2c-96e5-3cb42d30e79e tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:01.575389 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5d095f9d-7e2b-4b2c-96e5-3cb42d30e79e tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:01.575820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5d095f9d-7e2b-4b2c-96e5-3cb42d30e79e tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:01.618660 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1ac28f1b-044c-4453-808c-2035103abafc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:01.619234 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1ac28f1b-044c-4453-808c-2035103abafc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:01.625811 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1ac28f1b-044c-4453-808c-2035103abafc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:01.626599 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1ac28f1b-044c-4453-808c-2035103abafc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:01.627443 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1ac28f1b-044c-4453-808c-2035103abafc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:01.627973 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1ac28f1b-044c-4453-808c-2035103abafc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:01.775290 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5d095f9d-7e2b-4b2c-96e5-3cb42d30e79e tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:01.783036 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5d095f9d-7e2b-4b2c-96e5-3cb42d30e79e tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.221077 May 26 13:57:01.783619 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 91/173] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:01 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:01.794367 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-c5f0e2b7-41b8-42ef-a69d-7c01cd01b3c9 req-225e2712-b41b-4a2f-944e-9bd9c1e908c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9116ee60-50e6-48c5-bcc1-8e9d08e35458", "name": "network-vif-plugged", "status": "completed", "tag": "0d486a1e-7691-438f-a89c-df9425b682f1"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:57:01.798356 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1ac28f1b-044c-4453-808c-2035103abafc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:01.802930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-c5f0e2b7-41b8-42ef-a69d-7c01cd01b3c9 req-225e2712-b41b-4a2f-944e-9bd9c1e908c2 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:01.803643 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-c5f0e2b7-41b8-42ef-a69d-7c01cd01b3c9 req-225e2712-b41b-4a2f-944e-9bd9c1e908c2 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:01.807305 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1ac28f1b-044c-4453-808c-2035103abafc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.192399 May 26 13:57:01.808037 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 83/174] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:01 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:01.816580 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-c5f0e2b7-41b8-42ef-a69d-7c01cd01b3c9 req-225e2712-b41b-4a2f-944e-9bd9c1e908c2 service nova] Creating event network-vif-plugged:0d486a1e-7691-438f-a89c-df9425b682f1 for instance 9116ee60-50e6-48c5-bcc1-8e9d08e35458 on hv-cinder-84213 May 26 13:57:01.821563 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-c5f0e2b7-41b8-42ef-a69d-7c01cd01b3c9 req-225e2712-b41b-4a2f-944e-9bd9c1e908c2 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030560 May 26 13:57:01.822126 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 92/175] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 13:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:57:01.903332 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ef7cb251-316d-43a7-a368-1f9aee796336 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:01.904017 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ef7cb251-316d-43a7-a368-1f9aee796336 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:01.908503 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-49e8d973-d0c6-404e-b789-a7ec0ed79ce6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:01.909226 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-49e8d973-d0c6-404e-b789-a7ec0ed79ce6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:01.910990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ef7cb251-316d-43a7-a368-1f9aee796336 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:01.911654 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ef7cb251-316d-43a7-a368-1f9aee796336 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:01.912615 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ef7cb251-316d-43a7-a368-1f9aee796336 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:01.913286 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ef7cb251-316d-43a7-a368-1f9aee796336 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:01.915971 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-49e8d973-d0c6-404e-b789-a7ec0ed79ce6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:01.916680 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-49e8d973-d0c6-404e-b789-a7ec0ed79ce6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:01.917590 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-49e8d973-d0c6-404e-b789-a7ec0ed79ce6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:01.918130 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-49e8d973-d0c6-404e-b789-a7ec0ed79ce6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:02.150586 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ef7cb251-316d-43a7-a368-1f9aee796336 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:02.158631 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-49e8d973-d0c6-404e-b789-a7ec0ed79ce6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:02.159351 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ef7cb251-316d-43a7-a368-1f9aee796336 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1367 microversion: 2.1 time: 0.260538 May 26 13:57:02.159943 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 84/176] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:01 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:02.164647 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-eb383839-f799-4812-b68e-4fc1aa8cb5f3 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:02.165679 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-eb383839-f799-4812-b68e-4fc1aa8cb5f3 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:02.168376 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-49e8d973-d0c6-404e-b789-a7ec0ed79ce6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:02.170548 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-49e8d973-d0c6-404e-b789-a7ec0ed79ce6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:02.171917 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-49e8d973-d0c6-404e-b789-a7ec0ed79ce6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.267630 May 26 13:57:02.172785 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 93/177] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:57:01 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:57:02.177694 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eb383839-f799-4812-b68e-4fc1aa8cb5f3 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:02.178199 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eb383839-f799-4812-b68e-4fc1aa8cb5f3 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:02.178919 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eb383839-f799-4812-b68e-4fc1aa8cb5f3 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:02.179810 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eb383839-f799-4812-b68e-4fc1aa8cb5f3 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:02.379655 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-eb383839-f799-4812-b68e-4fc1aa8cb5f3 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:02.387788 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-eb383839-f799-4812-b68e-4fc1aa8cb5f3 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1272 microversion: 2.1 time: 0.226594 May 26 13:57:02.388721 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 85/178] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:02 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1272 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:02.800174 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-28b499ab-bae9-4964-9309-48f017d2297a tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:02.801545 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-28b499ab-bae9-4964-9309-48f017d2297a tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:02.808508 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28b499ab-bae9-4964-9309-48f017d2297a tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:02.810068 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28b499ab-bae9-4964-9309-48f017d2297a tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:02.811042 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28b499ab-bae9-4964-9309-48f017d2297a tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:02.811475 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28b499ab-bae9-4964-9309-48f017d2297a tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:02.824687 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bf5df40a-d874-41de-932c-31bcbeb10de4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:02.827329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bf5df40a-d874-41de-932c-31bcbeb10de4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:02.835640 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bf5df40a-d874-41de-932c-31bcbeb10de4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:02.836744 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bf5df40a-d874-41de-932c-31bcbeb10de4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:02.837777 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bf5df40a-d874-41de-932c-31bcbeb10de4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:02.838435 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bf5df40a-d874-41de-932c-31bcbeb10de4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:03.017201 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-28b499ab-bae9-4964-9309-48f017d2297a tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:03.023975 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bf5df40a-d874-41de-932c-31bcbeb10de4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:03.032333 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-28b499ab-bae9-4964-9309-48f017d2297a tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.235992 May 26 13:57:03.032831 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bf5df40a-d874-41de-932c-31bcbeb10de4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.212070 May 26 13:57:03.033904 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 86/179] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:02 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:03.036233 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 94/180] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:02 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:03.175712 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-00e49b8f-dbaa-4e94-8183-058ecfdb3819 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:03.176311 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-00e49b8f-dbaa-4e94-8183-058ecfdb3819 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:03.190730 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-00e49b8f-dbaa-4e94-8183-058ecfdb3819 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:03.191528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-00e49b8f-dbaa-4e94-8183-058ecfdb3819 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:03.192456 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-00e49b8f-dbaa-4e94-8183-058ecfdb3819 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:03.192994 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4cc3827a-7246-4a12-8d8a-5f69a4511330 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:03.193240 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-00e49b8f-dbaa-4e94-8183-058ecfdb3819 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:03.194169 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4cc3827a-7246-4a12-8d8a-5f69a4511330 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:03.203298 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4cc3827a-7246-4a12-8d8a-5f69a4511330 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:03.203746 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4cc3827a-7246-4a12-8d8a-5f69a4511330 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:03.204514 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4cc3827a-7246-4a12-8d8a-5f69a4511330 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:03.204944 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4cc3827a-7246-4a12-8d8a-5f69a4511330 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:03.388338 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-00e49b8f-dbaa-4e94-8183-058ecfdb3819 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:03.392089 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4cc3827a-7246-4a12-8d8a-5f69a4511330 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:03.396426 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-00e49b8f-dbaa-4e94-8183-058ecfdb3819 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1367 microversion: 2.1 time: 0.224456 May 26 13:57:03.396991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 87/181] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:03 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:03.400475 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4cc3827a-7246-4a12-8d8a-5f69a4511330 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:03.402808 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4cc3827a-7246-4a12-8d8a-5f69a4511330 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:03.403975 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4cc3827a-7246-4a12-8d8a-5f69a4511330 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.216882 May 26 13:57:03.404525 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 95/182] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:57:03 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:57:03.405074 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-331ac555-6f43-4906-b0fc-ff9898f2c00d tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:03.405910 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-331ac555-6f43-4906-b0fc-ff9898f2c00d tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:03.411799 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-331ac555-6f43-4906-b0fc-ff9898f2c00d tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:03.412305 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-331ac555-6f43-4906-b0fc-ff9898f2c00d tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:03.413124 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-331ac555-6f43-4906-b0fc-ff9898f2c00d tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:03.413646 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-331ac555-6f43-4906-b0fc-ff9898f2c00d tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:03.545379 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-331ac555-6f43-4906-b0fc-ff9898f2c00d tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:03.562102 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-331ac555-6f43-4906-b0fc-ff9898f2c00d tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.152552 May 26 13:57:03.562102 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 88/183] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:03 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:04.055239 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2de0f173-d0e1-4027-b4e9-6622efeecabd tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:04.055862 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2de0f173-d0e1-4027-b4e9-6622efeecabd tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:04.056644 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1f4d253c-324f-4f80-8d9e-32b6a2238b9d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:04.057272 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1f4d253c-324f-4f80-8d9e-32b6a2238b9d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:04.061970 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2de0f173-d0e1-4027-b4e9-6622efeecabd tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:04.062420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2de0f173-d0e1-4027-b4e9-6622efeecabd tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:04.063161 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2de0f173-d0e1-4027-b4e9-6622efeecabd tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:04.063262 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1f4d253c-324f-4f80-8d9e-32b6a2238b9d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:04.063590 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2de0f173-d0e1-4027-b4e9-6622efeecabd tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:04.063718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1f4d253c-324f-4f80-8d9e-32b6a2238b9d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:04.064351 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1f4d253c-324f-4f80-8d9e-32b6a2238b9d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:04.064782 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1f4d253c-324f-4f80-8d9e-32b6a2238b9d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:04.252522 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2de0f173-d0e1-4027-b4e9-6622efeecabd tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:04.259859 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2de0f173-d0e1-4027-b4e9-6622efeecabd tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.208411 May 26 13:57:04.260684 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 96/184] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:04 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:04.263544 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1f4d253c-324f-4f80-8d9e-32b6a2238b9d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:04.271502 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1f4d253c-324f-4f80-8d9e-32b6a2238b9d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.218262 May 26 13:57:04.272053 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 89/185] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:04 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:04.413165 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-dd515192-a878-46cd-9c1b-c2c930050473 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:04.413769 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-dd515192-a878-46cd-9c1b-c2c930050473 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:04.419834 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd515192-a878-46cd-9c1b-c2c930050473 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:04.420277 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd515192-a878-46cd-9c1b-c2c930050473 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:04.420954 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b6c26cde-4ae2-4cb3-ba5d-bf59bbab73d8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:04.421070 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd515192-a878-46cd-9c1b-c2c930050473 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:04.421477 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd515192-a878-46cd-9c1b-c2c930050473 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:04.421579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b6c26cde-4ae2-4cb3-ba5d-bf59bbab73d8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:04.427483 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b6c26cde-4ae2-4cb3-ba5d-bf59bbab73d8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:04.427927 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b6c26cde-4ae2-4cb3-ba5d-bf59bbab73d8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:04.428683 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b6c26cde-4ae2-4cb3-ba5d-bf59bbab73d8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:04.429115 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b6c26cde-4ae2-4cb3-ba5d-bf59bbab73d8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:04.613431 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-dd515192-a878-46cd-9c1b-c2c930050473 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:04.616847 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b6c26cde-4ae2-4cb3-ba5d-bf59bbab73d8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:04.621140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-dd515192-a878-46cd-9c1b-c2c930050473 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1367 microversion: 2.1 time: 0.211724 May 26 13:57:04.625198 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 97/186] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:04 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:04.625352 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b6c26cde-4ae2-4cb3-ba5d-bf59bbab73d8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:04.626393 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-11ee259c-d48a-4738-a577-919e716a286b tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:04.626700 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b6c26cde-4ae2-4cb3-ba5d-bf59bbab73d8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:04.626986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-11ee259c-d48a-4738-a577-919e716a286b tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:04.627792 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b6c26cde-4ae2-4cb3-ba5d-bf59bbab73d8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.210591 May 26 13:57:04.628507 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 90/187] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:57:04 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:57:04.632966 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-11ee259c-d48a-4738-a577-919e716a286b tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:04.635132 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-11ee259c-d48a-4738-a577-919e716a286b tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:04.635132 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-11ee259c-d48a-4738-a577-919e716a286b tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:04.635132 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-11ee259c-d48a-4738-a577-919e716a286b tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:04.765306 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-11ee259c-d48a-4738-a577-919e716a286b tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:04.772557 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-11ee259c-d48a-4738-a577-919e716a286b tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.149646 May 26 13:57:04.773115 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 98/188] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:04 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:05.276511 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dffca7d2-30be-4f36-903f-50e12c637ad7 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:05.277114 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-dffca7d2-30be-4f36-903f-50e12c637ad7 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:05.284053 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dffca7d2-30be-4f36-903f-50e12c637ad7 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:05.284541 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dffca7d2-30be-4f36-903f-50e12c637ad7 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:05.285336 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dffca7d2-30be-4f36-903f-50e12c637ad7 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:05.285770 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dffca7d2-30be-4f36-903f-50e12c637ad7 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:05.288255 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e4c998b8-72eb-4099-a7d0-fb6044242f31 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:05.288929 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e4c998b8-72eb-4099-a7d0-fb6044242f31 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:05.295496 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4c998b8-72eb-4099-a7d0-fb6044242f31 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:05.295941 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4c998b8-72eb-4099-a7d0-fb6044242f31 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:05.296699 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4c998b8-72eb-4099-a7d0-fb6044242f31 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:05.297130 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4c998b8-72eb-4099-a7d0-fb6044242f31 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:05.475569 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dffca7d2-30be-4f36-903f-50e12c637ad7 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:05.479761 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e4c998b8-72eb-4099-a7d0-fb6044242f31 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:05.488821 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dffca7d2-30be-4f36-903f-50e12c637ad7 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1315 microversion: 2.1 time: 0.215819 May 26 13:57:05.490596 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 91/189] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:05 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:05.492754 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e4c998b8-72eb-4099-a7d0-fb6044242f31 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.208431 May 26 13:57:05.493367 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 99/190] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:05 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:05.642730 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-400eebdb-5c92-4095-8b7f-7531eeb96123 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:05.643555 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-400eebdb-5c92-4095-8b7f-7531eeb96123 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:05.645274 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-47edcadd-0259-4634-a090-027ffa03ee60 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:05.646068 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-47edcadd-0259-4634-a090-027ffa03ee60 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:05.649580 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-400eebdb-5c92-4095-8b7f-7531eeb96123 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:05.650028 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-400eebdb-5c92-4095-8b7f-7531eeb96123 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:05.652103 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-400eebdb-5c92-4095-8b7f-7531eeb96123 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:05.652798 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-400eebdb-5c92-4095-8b7f-7531eeb96123 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:05.653034 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-47edcadd-0259-4634-a090-027ffa03ee60 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:05.653688 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-47edcadd-0259-4634-a090-027ffa03ee60 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:05.655182 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-47edcadd-0259-4634-a090-027ffa03ee60 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:05.655775 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-47edcadd-0259-4634-a090-027ffa03ee60 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:05.865731 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-400eebdb-5c92-4095-8b7f-7531eeb96123 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:05.873708 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-400eebdb-5c92-4095-8b7f-7531eeb96123 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1367 microversion: 2.1 time: 0.234766 May 26 13:57:05.874407 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 92/191] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:05 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:05.879800 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-47edcadd-0259-4634-a090-027ffa03ee60 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:05.879987 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-05360a11-08c7-4882-a218-efa419954c22 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:05.880482 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-05360a11-08c7-4882-a218-efa419954c22 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:05.886961 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05360a11-08c7-4882-a218-efa419954c22 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:05.887435 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05360a11-08c7-4882-a218-efa419954c22 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:05.889188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05360a11-08c7-4882-a218-efa419954c22 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:05.889741 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05360a11-08c7-4882-a218-efa419954c22 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:05.893196 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-47edcadd-0259-4634-a090-027ffa03ee60 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:05.895098 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-47edcadd-0259-4634-a090-027ffa03ee60 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:05.896723 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-47edcadd-0259-4634-a090-027ffa03ee60 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.255420 May 26 13:57:05.899426 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 100/192] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:57:05 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:57:06.067196 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-05360a11-08c7-4882-a218-efa419954c22 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:06.074611 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-05360a11-08c7-4882-a218-efa419954c22 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.199271 May 26 13:57:06.075210 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 93/193] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:05 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:06.507596 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0c1df835-455e-4a93-8dda-e081ac5c6299 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:06.508220 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0c1df835-455e-4a93-8dda-e081ac5c6299 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:06.510084 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3c2490d4-1afa-4412-bbe3-af4ff53ce611 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:06.510810 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3c2490d4-1afa-4412-bbe3-af4ff53ce611 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:06.516337 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0c1df835-455e-4a93-8dda-e081ac5c6299 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:06.518108 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0c1df835-455e-4a93-8dda-e081ac5c6299 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:06.518749 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c2490d4-1afa-4412-bbe3-af4ff53ce611 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:06.519362 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c2490d4-1afa-4412-bbe3-af4ff53ce611 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:06.520257 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c2490d4-1afa-4412-bbe3-af4ff53ce611 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:06.520596 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0c1df835-455e-4a93-8dda-e081ac5c6299 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:06.520989 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c2490d4-1afa-4412-bbe3-af4ff53ce611 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:06.521636 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0c1df835-455e-4a93-8dda-e081ac5c6299 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:06.812310 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3c2490d4-1afa-4412-bbe3-af4ff53ce611 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:06.831918 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3c2490d4-1afa-4412-bbe3-af4ff53ce611 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.325601 May 26 13:57:06.832656 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 94/194] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:06 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:06.847074 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0c1df835-455e-4a93-8dda-e081ac5c6299 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:06.849787 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-55ec7485-26de-4832-a822-38d119b6f9ed req-040622d4-566e-4a67-8a4e-3f03586f7fbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deead541-6f7c-4096-819b-0a8fe84acd53", "tag": "8b18d3a7-cd65-4ce0-bf45-5db8540263cd"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:57:06.856803 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0c1df835-455e-4a93-8dda-e081ac5c6299 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1501 microversion: 2.1 time: 0.353252 May 26 13:57:06.858954 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 101/195] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:06 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1501 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:06.871398 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-55ec7485-26de-4832-a822-38d119b6f9ed req-040622d4-566e-4a67-8a4e-3f03586f7fbc service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:06.872188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-55ec7485-26de-4832-a822-38d119b6f9ed req-040622d4-566e-4a67-8a4e-3f03586f7fbc service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:06.892394 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6096999d-124a-40b6-bd68-bd288e068eeb tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:06.893020 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6096999d-124a-40b6-bd68-bd288e068eeb tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:06.895188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-55ec7485-26de-4832-a822-38d119b6f9ed req-040622d4-566e-4a67-8a4e-3f03586f7fbc service nova] Creating event network-changed:8b18d3a7-cd65-4ce0-bf45-5db8540263cd for instance deead541-6f7c-4096-819b-0a8fe84acd53 on hv-cinder-84213 May 26 13:57:06.900626 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6096999d-124a-40b6-bd68-bd288e068eeb tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:06.901363 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6096999d-124a-40b6-bd68-bd288e068eeb tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:06.902573 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6096999d-124a-40b6-bd68-bd288e068eeb tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:06.903227 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6096999d-124a-40b6-bd68-bd288e068eeb tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:06.920594 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-55ec7485-26de-4832-a822-38d119b6f9ed req-040622d4-566e-4a67-8a4e-3f03586f7fbc service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084286 May 26 13:57:06.921946 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 95/196] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 13:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:57:06.936500 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c476293b-3687-4e09-9197-a27cb91d6999 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:06.937327 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c476293b-3687-4e09-9197-a27cb91d6999 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:06.951389 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c476293b-3687-4e09-9197-a27cb91d6999 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:06.953136 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c476293b-3687-4e09-9197-a27cb91d6999 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:06.954146 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c476293b-3687-4e09-9197-a27cb91d6999 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:06.954746 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c476293b-3687-4e09-9197-a27cb91d6999 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:07.324983 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6096999d-124a-40b6-bd68-bd288e068eeb tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:07.349403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6096999d-124a-40b6-bd68-bd288e068eeb tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1558 microversion: 2.1 time: 0.459858 May 26 13:57:07.350319 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 102/197] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:06 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1558 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:07.362649 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-72895e67-cb78-4e0a-955b-09cb47345f31 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:07.364753 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-72895e67-cb78-4e0a-955b-09cb47345f31 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:07.381252 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-72895e67-cb78-4e0a-955b-09cb47345f31 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:07.381899 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-72895e67-cb78-4e0a-955b-09cb47345f31 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:07.382745 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-72895e67-cb78-4e0a-955b-09cb47345f31 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:07.383239 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-72895e67-cb78-4e0a-955b-09cb47345f31 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:07.421275 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:07.426554 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c476293b-3687-4e09-9197-a27cb91d6999 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:07.437479 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c476293b-3687-4e09-9197-a27cb91d6999 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:07.442661 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c476293b-3687-4e09-9197-a27cb91d6999 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:07.446776 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c476293b-3687-4e09-9197-a27cb91d6999 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.521851 May 26 13:57:07.448357 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 96/198] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:57:06 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:57:07.460468 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a3caef60-08f4-4bce-b8fb-3fc9c73db631 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:07.460872 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a3caef60-08f4-4bce-b8fb-3fc9c73db631 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:07.477507 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a3caef60-08f4-4bce-b8fb-3fc9c73db631 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:07.477940 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a3caef60-08f4-4bce-b8fb-3fc9c73db631 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:07.478753 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a3caef60-08f4-4bce-b8fb-3fc9c73db631 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:07.479183 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a3caef60-08f4-4bce-b8fb-3fc9c73db631 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:07.586123 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-72895e67-cb78-4e0a-955b-09cb47345f31 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:07.594177 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-72895e67-cb78-4e0a-955b-09cb47345f31 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.241800 May 26 13:57:07.594756 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 103/199] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:07 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:07.619863 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a3caef60-08f4-4bce-b8fb-3fc9c73db631 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.163285 May 26 13:57:07.620475 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 97/200] 10.222.0.91 () {58 vars in 1274 bytes} [Thu May 26 13:57:07 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2/os-interface => generated 285 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:57:07.849192 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0c5f2273-7124-4ba9-ac35-23730d2629d8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:07.850173 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0c5f2273-7124-4ba9-ac35-23730d2629d8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:07.856497 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0c5f2273-7124-4ba9-ac35-23730d2629d8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:07.857070 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0c5f2273-7124-4ba9-ac35-23730d2629d8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:07.857981 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0c5f2273-7124-4ba9-ac35-23730d2629d8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:07.858519 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0c5f2273-7124-4ba9-ac35-23730d2629d8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:08.360833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0c5f2273-7124-4ba9-ac35-23730d2629d8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:08.368241 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0c5f2273-7124-4ba9-ac35-23730d2629d8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.522941 May 26 13:57:08.368805 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 104/201] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:07 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:08.465260 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8022db75-7d2f-45ad-9148-511df6bca8fb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:08.465860 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8022db75-7d2f-45ad-9148-511df6bca8fb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:08.472354 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8022db75-7d2f-45ad-9148-511df6bca8fb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:08.472800 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8022db75-7d2f-45ad-9148-511df6bca8fb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:08.473585 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8022db75-7d2f-45ad-9148-511df6bca8fb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:08.474027 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8022db75-7d2f-45ad-9148-511df6bca8fb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:08.612060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6641b6dd-66f9-4a06-8cd0-d75d7b3393b7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:08.612732 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6641b6dd-66f9-4a06-8cd0-d75d7b3393b7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:08.618966 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6641b6dd-66f9-4a06-8cd0-d75d7b3393b7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:08.619418 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6641b6dd-66f9-4a06-8cd0-d75d7b3393b7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:08.620183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6641b6dd-66f9-4a06-8cd0-d75d7b3393b7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:08.620617 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6641b6dd-66f9-4a06-8cd0-d75d7b3393b7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:08.788167 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8022db75-7d2f-45ad-9148-511df6bca8fb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:08.796766 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8022db75-7d2f-45ad-9148-511df6bca8fb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:08.798307 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8022db75-7d2f-45ad-9148-511df6bca8fb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:08.799416 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8022db75-7d2f-45ad-9148-511df6bca8fb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.338155 May 26 13:57:08.799978 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 98/202] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:57:08 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:57:08.869043 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6641b6dd-66f9-4a06-8cd0-d75d7b3393b7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:08.876628 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6641b6dd-66f9-4a06-8cd0-d75d7b3393b7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.269056 May 26 13:57:08.877216 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 105/203] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:08 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:09.163954 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-50ad44cb-f832-48ee-b1a0-0946f5abd208 req-6f61e006-62c3-4258-b969-c891c85ce59f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71af8283-a8f5-44e7-bdcd-6606070472b2", "tag": "44b52c9b-2e5c-490a-ab42-cd30ca4bea28"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:57:09.171944 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-50ad44cb-f832-48ee-b1a0-0946f5abd208 req-6f61e006-62c3-4258-b969-c891c85ce59f service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:09.172388 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-50ad44cb-f832-48ee-b1a0-0946f5abd208 req-6f61e006-62c3-4258-b969-c891c85ce59f service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:09.190099 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-50ad44cb-f832-48ee-b1a0-0946f5abd208 req-6f61e006-62c3-4258-b969-c891c85ce59f service nova] Creating event network-changed:44b52c9b-2e5c-490a-ab42-cd30ca4bea28 for instance 71af8283-a8f5-44e7-bdcd-6606070472b2 on hv-cinder-84213 May 26 13:57:09.195394 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-50ad44cb-f832-48ee-b1a0-0946f5abd208 req-6f61e006-62c3-4258-b969-c891c85ce59f service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036459 May 26 13:57:09.196479 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 99/204] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 13:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:57:09.385687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9ecee7c9-1bc0-4148-9efc-bc77586c183a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:09.386373 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9ecee7c9-1bc0-4148-9efc-bc77586c183a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:09.392840 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9ecee7c9-1bc0-4148-9efc-bc77586c183a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:09.393322 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9ecee7c9-1bc0-4148-9efc-bc77586c183a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:09.394071 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9ecee7c9-1bc0-4148-9efc-bc77586c183a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:09.394498 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9ecee7c9-1bc0-4148-9efc-bc77586c183a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:09.522428 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9ecee7c9-1bc0-4148-9efc-bc77586c183a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:09.530540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9ecee7c9-1bc0-4148-9efc-bc77586c183a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.148712 May 26 13:57:09.531529 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 106/205] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:09 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:09.817981 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d2c0bc94-55ca-419b-8897-6ad3b89cf4ac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:09.818662 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d2c0bc94-55ca-419b-8897-6ad3b89cf4ac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:09.824837 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d2c0bc94-55ca-419b-8897-6ad3b89cf4ac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:09.825323 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d2c0bc94-55ca-419b-8897-6ad3b89cf4ac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:09.826072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d2c0bc94-55ca-419b-8897-6ad3b89cf4ac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:09.826681 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d2c0bc94-55ca-419b-8897-6ad3b89cf4ac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:09.893485 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-bddd3540-3355-4154-9984-b16e5994940e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:09.894089 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-bddd3540-3355-4154-9984-b16e5994940e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:09.900343 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bddd3540-3355-4154-9984-b16e5994940e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:09.900833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bddd3540-3355-4154-9984-b16e5994940e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:09.901638 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bddd3540-3355-4154-9984-b16e5994940e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:09.902430 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bddd3540-3355-4154-9984-b16e5994940e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:10.022022 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d2c0bc94-55ca-419b-8897-6ad3b89cf4ac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:10.024825 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:10.033839 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d2c0bc94-55ca-419b-8897-6ad3b89cf4ac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:10.035654 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d2c0bc94-55ca-419b-8897-6ad3b89cf4ac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:10.037104 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d2c0bc94-55ca-419b-8897-6ad3b89cf4ac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.223109 May 26 13:57:10.038218 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 100/206] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:57:09 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:57:10.078296 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bddd3540-3355-4154-9984-b16e5994940e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:10.086257 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-bddd3540-3355-4154-9984-b16e5994940e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.196648 May 26 13:57:10.086838 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 107/207] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:09 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:10.548930 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-33d901d2-09b6-43b7-9513-ec588f5a439f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:10.549579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-33d901d2-09b6-43b7-9513-ec588f5a439f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:10.555878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-33d901d2-09b6-43b7-9513-ec588f5a439f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:10.556330 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-33d901d2-09b6-43b7-9513-ec588f5a439f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:10.557105 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-33d901d2-09b6-43b7-9513-ec588f5a439f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:10.557573 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-33d901d2-09b6-43b7-9513-ec588f5a439f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:10.696441 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-33d901d2-09b6-43b7-9513-ec588f5a439f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:10.705138 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-33d901d2-09b6-43b7-9513-ec588f5a439f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.160028 May 26 13:57:10.705751 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 101/208] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:10 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:11.054789 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d533946a-7de0-4a1c-b6b5-89df7a4b547b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:11.055565 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d533946a-7de0-4a1c-b6b5-89df7a4b547b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:11.062510 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d533946a-7de0-4a1c-b6b5-89df7a4b547b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:11.062957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d533946a-7de0-4a1c-b6b5-89df7a4b547b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:11.063722 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d533946a-7de0-4a1c-b6b5-89df7a4b547b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:11.064150 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d533946a-7de0-4a1c-b6b5-89df7a4b547b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:11.103709 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f596c671-00b8-41bb-b722-eb032aa91197 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:11.104350 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f596c671-00b8-41bb-b722-eb032aa91197 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:11.111201 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f596c671-00b8-41bb-b722-eb032aa91197 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:11.111600 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f596c671-00b8-41bb-b722-eb032aa91197 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:11.112374 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f596c671-00b8-41bb-b722-eb032aa91197 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:11.112801 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f596c671-00b8-41bb-b722-eb032aa91197 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:11.243700 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d533946a-7de0-4a1c-b6b5-89df7a4b547b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:11.254790 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d533946a-7de0-4a1c-b6b5-89df7a4b547b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:11.256956 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d533946a-7de0-4a1c-b6b5-89df7a4b547b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:11.258319 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d533946a-7de0-4a1c-b6b5-89df7a4b547b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.207494 May 26 13:57:11.259071 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 108/209] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:57:11 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:57:11.276732 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f596c671-00b8-41bb-b722-eb032aa91197 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:11.284862 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f596c671-00b8-41bb-b722-eb032aa91197 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.184993 May 26 13:57:11.285446 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 102/210] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:11 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:11.722074 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e5742116-6e29-4f61-a3e5-4bbaedfe47d9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:11.722679 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e5742116-6e29-4f61-a3e5-4bbaedfe47d9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:11.728931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e5742116-6e29-4f61-a3e5-4bbaedfe47d9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:11.729402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e5742116-6e29-4f61-a3e5-4bbaedfe47d9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:11.730159 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e5742116-6e29-4f61-a3e5-4bbaedfe47d9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:11.730583 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e5742116-6e29-4f61-a3e5-4bbaedfe47d9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:11.867893 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e5742116-6e29-4f61-a3e5-4bbaedfe47d9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:11.875845 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e5742116-6e29-4f61-a3e5-4bbaedfe47d9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.157501 May 26 13:57:11.876337 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 109/211] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:11 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:12.275924 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3f609b94-9bfa-4aad-aa64-e0b92b579085 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:12.276550 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3f609b94-9bfa-4aad-aa64-e0b92b579085 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:12.283277 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f609b94-9bfa-4aad-aa64-e0b92b579085 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:12.283277 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f609b94-9bfa-4aad-aa64-e0b92b579085 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:12.284036 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f609b94-9bfa-4aad-aa64-e0b92b579085 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:12.284460 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f609b94-9bfa-4aad-aa64-e0b92b579085 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:12.300949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-95e89fd3-339a-41fb-8b6e-88932122ddd9 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:12.301628 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-95e89fd3-339a-41fb-8b6e-88932122ddd9 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:12.307634 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-95e89fd3-339a-41fb-8b6e-88932122ddd9 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:12.308083 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-95e89fd3-339a-41fb-8b6e-88932122ddd9 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:12.308852 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-95e89fd3-339a-41fb-8b6e-88932122ddd9 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:12.309307 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-95e89fd3-339a-41fb-8b6e-88932122ddd9 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:12.480642 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3f609b94-9bfa-4aad-aa64-e0b92b579085 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:12.483834 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-95e89fd3-339a-41fb-8b6e-88932122ddd9 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:12.488770 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3f609b94-9bfa-4aad-aa64-e0b92b579085 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:12.490429 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3f609b94-9bfa-4aad-aa64-e0b92b579085 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:12.491189 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-95e89fd3-339a-41fb-8b6e-88932122ddd9 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.194013 May 26 13:57:12.491636 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3f609b94-9bfa-4aad-aa64-e0b92b579085 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.219551 May 26 13:57:12.491767 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 110/212] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:12 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:12.492182 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 103/213] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:57:12 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:57:12.891628 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d5185d83-1738-4f1e-940b-fa4d2a592987 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:12.892237 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d5185d83-1738-4f1e-940b-fa4d2a592987 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:12.898267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d5185d83-1738-4f1e-940b-fa4d2a592987 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:12.898746 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d5185d83-1738-4f1e-940b-fa4d2a592987 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:12.899504 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d5185d83-1738-4f1e-940b-fa4d2a592987 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:12.899943 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d5185d83-1738-4f1e-940b-fa4d2a592987 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:13.162097 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d5185d83-1738-4f1e-940b-fa4d2a592987 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:13.170193 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d5185d83-1738-4f1e-940b-fa4d2a592987 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.281702 May 26 13:57:13.170750 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 111/214] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:12 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:13.508282 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3d9dde2f-7afe-4711-8a31-134fe692df6e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:13.509446 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3d9dde2f-7afe-4711-8a31-134fe692df6e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:13.512610 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d00d4b68-5813-4496-a7a8-1a6055f84aa1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:13.513733 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d00d4b68-5813-4496-a7a8-1a6055f84aa1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:13.516643 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3d9dde2f-7afe-4711-8a31-134fe692df6e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:13.517318 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3d9dde2f-7afe-4711-8a31-134fe692df6e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:13.518072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3d9dde2f-7afe-4711-8a31-134fe692df6e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:13.518682 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3d9dde2f-7afe-4711-8a31-134fe692df6e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:13.519761 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d00d4b68-5813-4496-a7a8-1a6055f84aa1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:13.520367 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d00d4b68-5813-4496-a7a8-1a6055f84aa1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:13.521133 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d00d4b68-5813-4496-a7a8-1a6055f84aa1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:13.521601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d00d4b68-5813-4496-a7a8-1a6055f84aa1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:13.730783 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3d9dde2f-7afe-4711-8a31-134fe692df6e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:13.739194 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3d9dde2f-7afe-4711-8a31-134fe692df6e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.234596 May 26 13:57:13.740309 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 104/215] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:13 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:13.741696 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d00d4b68-5813-4496-a7a8-1a6055f84aa1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:13.751398 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d00d4b68-5813-4496-a7a8-1a6055f84aa1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:13.753214 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d00d4b68-5813-4496-a7a8-1a6055f84aa1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:13.754771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d00d4b68-5813-4496-a7a8-1a6055f84aa1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.246707 May 26 13:57:13.756203 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 112/216] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:57:13 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:57:13.840863 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5ce76cc1-1548-4794-9108-d1bc8e32fb2c tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bfe8be6-f7e6-4724-a749-a78a42fef046"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:57:13.842297 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5ce76cc1-1548-4794-9108-d1bc8e32fb2c tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:13.852892 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5ce76cc1-1548-4794-9108-d1bc8e32fb2c tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:13.852892 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5ce76cc1-1548-4794-9108-d1bc8e32fb2c tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:13.852892 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5ce76cc1-1548-4794-9108-d1bc8e32fb2c tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:13.852892 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5ce76cc1-1548-4794-9108-d1bc8e32fb2c tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:14.189497 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f4e003df-67cf-44e4-b119-967c3aa74083 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:14.190110 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f4e003df-67cf-44e4-b119-967c3aa74083 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:14.197117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f4e003df-67cf-44e4-b119-967c3aa74083 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:14.197405 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f4e003df-67cf-44e4-b119-967c3aa74083 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:14.198231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f4e003df-67cf-44e4-b119-967c3aa74083 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:14.198510 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f4e003df-67cf-44e4-b119-967c3aa74083 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:14.358299 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f4e003df-67cf-44e4-b119-967c3aa74083 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:14.365735 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f4e003df-67cf-44e4-b119-967c3aa74083 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.181434 May 26 13:57:14.366306 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 113/217] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:14 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:14.757402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ed0c5dbf-fde6-42e1-8567-74f72e78d94c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:14.758097 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ed0c5dbf-fde6-42e1-8567-74f72e78d94c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:14.763952 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ed0c5dbf-fde6-42e1-8567-74f72e78d94c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:14.764398 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ed0c5dbf-fde6-42e1-8567-74f72e78d94c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:14.765172 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ed0c5dbf-fde6-42e1-8567-74f72e78d94c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:14.765607 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ed0c5dbf-fde6-42e1-8567-74f72e78d94c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:14.902731 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ed0c5dbf-fde6-42e1-8567-74f72e78d94c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:14.911044 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ed0c5dbf-fde6-42e1-8567-74f72e78d94c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.157607 May 26 13:57:14.911604 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 114/218] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:14 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:14.916067 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0dda7954-b324-4118-b0f8-d6aeae7ffa13 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:14.916660 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0dda7954-b324-4118-b0f8-d6aeae7ffa13 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:14.922267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0dda7954-b324-4118-b0f8-d6aeae7ffa13 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:14.922715 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0dda7954-b324-4118-b0f8-d6aeae7ffa13 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:14.923462 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0dda7954-b324-4118-b0f8-d6aeae7ffa13 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:14.923896 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0dda7954-b324-4118-b0f8-d6aeae7ffa13 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:15.049467 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0dda7954-b324-4118-b0f8-d6aeae7ffa13 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:15.057546 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0dda7954-b324-4118-b0f8-d6aeae7ffa13 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:15.059075 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0dda7954-b324-4118-b0f8-d6aeae7ffa13 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:15.060194 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0dda7954-b324-4118-b0f8-d6aeae7ffa13 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.147658 May 26 13:57:15.060741 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 115/219] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:57:14 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:57:15.383828 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-92334be7-4e69-46e7-bcda-cfbeb333ca4a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:15.384343 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-92334be7-4e69-46e7-bcda-cfbeb333ca4a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:15.391570 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-92334be7-4e69-46e7-bcda-cfbeb333ca4a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:15.392018 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-92334be7-4e69-46e7-bcda-cfbeb333ca4a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:15.392770 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-92334be7-4e69-46e7-bcda-cfbeb333ca4a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:15.393229 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-92334be7-4e69-46e7-bcda-cfbeb333ca4a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:15.522546 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-92334be7-4e69-46e7-bcda-cfbeb333ca4a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:15.530250 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-92334be7-4e69-46e7-bcda-cfbeb333ca4a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.150842 May 26 13:57:15.530815 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 116/220] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:15 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:15.926845 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1de29922-f649-4dee-bcb4-34f49c7fc2bb tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:15.927470 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1de29922-f649-4dee-bcb4-34f49c7fc2bb tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:15.933753 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1de29922-f649-4dee-bcb4-34f49c7fc2bb tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:15.934207 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1de29922-f649-4dee-bcb4-34f49c7fc2bb tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:15.935108 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1de29922-f649-4dee-bcb4-34f49c7fc2bb tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:15.935554 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1de29922-f649-4dee-bcb4-34f49c7fc2bb tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:16.062342 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1de29922-f649-4dee-bcb4-34f49c7fc2bb tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:16.069931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1de29922-f649-4dee-bcb4-34f49c7fc2bb tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.146986 May 26 13:57:16.070491 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 117/221] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:15 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:16.077516 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-dd69dd8c-2ec4-4dac-ba05-e91984537c06 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:16.078054 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-dd69dd8c-2ec4-4dac-ba05-e91984537c06 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:16.083862 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd69dd8c-2ec4-4dac-ba05-e91984537c06 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:16.084308 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd69dd8c-2ec4-4dac-ba05-e91984537c06 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:16.085067 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd69dd8c-2ec4-4dac-ba05-e91984537c06 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:16.085535 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd69dd8c-2ec4-4dac-ba05-e91984537c06 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:16.214419 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-dd69dd8c-2ec4-4dac-ba05-e91984537c06 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:16.222961 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-dd69dd8c-2ec4-4dac-ba05-e91984537c06 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:16.224526 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-dd69dd8c-2ec4-4dac-ba05-e91984537c06 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:16.225754 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-dd69dd8c-2ec4-4dac-ba05-e91984537c06 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.151954 May 26 13:57:16.226301 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 118/222] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:57:16 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:57:16.546708 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-eb984a61-41d8-42ef-8ab3-eea5667865a0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:16.547319 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-eb984a61-41d8-42ef-8ab3-eea5667865a0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:16.553380 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb984a61-41d8-42ef-8ab3-eea5667865a0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:16.553866 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb984a61-41d8-42ef-8ab3-eea5667865a0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:16.554625 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb984a61-41d8-42ef-8ab3-eea5667865a0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:16.555060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb984a61-41d8-42ef-8ab3-eea5667865a0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:16.690258 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-eb984a61-41d8-42ef-8ab3-eea5667865a0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:16.697045 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-eb984a61-41d8-42ef-8ab3-eea5667865a0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.154748 May 26 13:57:16.697655 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 119/223] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:16 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:17.086635 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-35322a29-ac09-41f2-957f-aa6232e80f04 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:17.087294 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-35322a29-ac09-41f2-957f-aa6232e80f04 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:17.093864 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-35322a29-ac09-41f2-957f-aa6232e80f04 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:17.094311 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-35322a29-ac09-41f2-957f-aa6232e80f04 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:17.095066 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-35322a29-ac09-41f2-957f-aa6232e80f04 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:17.095504 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-35322a29-ac09-41f2-957f-aa6232e80f04 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:17.099470 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:17.220132 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-35322a29-ac09-41f2-957f-aa6232e80f04 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:17.227565 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-35322a29-ac09-41f2-957f-aa6232e80f04 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.144836 May 26 13:57:17.228127 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 120/224] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:17 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:17.243951 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4f29c2d7-4bea-4014-a825-8049b42b4e75 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:17.244551 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4f29c2d7-4bea-4014-a825-8049b42b4e75 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:17.250536 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4f29c2d7-4bea-4014-a825-8049b42b4e75 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:17.250983 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4f29c2d7-4bea-4014-a825-8049b42b4e75 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:17.251738 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4f29c2d7-4bea-4014-a825-8049b42b4e75 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:17.252167 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4f29c2d7-4bea-4014-a825-8049b42b4e75 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:17.380324 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4f29c2d7-4bea-4014-a825-8049b42b4e75 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:17.388726 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4f29c2d7-4bea-4014-a825-8049b42b4e75 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:17.390280 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4f29c2d7-4bea-4014-a825-8049b42b4e75 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:17.391371 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4f29c2d7-4bea-4014-a825-8049b42b4e75 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.151133 May 26 13:57:17.391929 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 121/225] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:57:17 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:57:17.713698 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0666ab0d-26af-4843-a5ad-0e101efa8349 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:17.714386 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0666ab0d-26af-4843-a5ad-0e101efa8349 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:17.720974 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0666ab0d-26af-4843-a5ad-0e101efa8349 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:17.721448 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0666ab0d-26af-4843-a5ad-0e101efa8349 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:17.722329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0666ab0d-26af-4843-a5ad-0e101efa8349 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:17.722669 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0666ab0d-26af-4843-a5ad-0e101efa8349 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:17.846594 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0666ab0d-26af-4843-a5ad-0e101efa8349 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:17.854006 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0666ab0d-26af-4843-a5ad-0e101efa8349 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.144130 May 26 13:57:17.854563 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 122/226] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:17 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:18.244415 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7b5cb6c4-8b1f-4289-b4bd-26d3660ba6cf tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:18.244993 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7b5cb6c4-8b1f-4289-b4bd-26d3660ba6cf tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:18.251282 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7b5cb6c4-8b1f-4289-b4bd-26d3660ba6cf tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:18.251721 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7b5cb6c4-8b1f-4289-b4bd-26d3660ba6cf tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:18.252463 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7b5cb6c4-8b1f-4289-b4bd-26d3660ba6cf tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:18.252889 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7b5cb6c4-8b1f-4289-b4bd-26d3660ba6cf tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:18.383524 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7b5cb6c4-8b1f-4289-b4bd-26d3660ba6cf tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:18.390849 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7b5cb6c4-8b1f-4289-b4bd-26d3660ba6cf tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.150324 May 26 13:57:18.391409 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 123/227] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:18 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:18.409422 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-33b95a76-0c1b-4b86-a145-7754255ba278 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:18.410024 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-33b95a76-0c1b-4b86-a145-7754255ba278 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:18.417092 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-33b95a76-0c1b-4b86-a145-7754255ba278 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:18.417653 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-33b95a76-0c1b-4b86-a145-7754255ba278 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:18.418640 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-33b95a76-0c1b-4b86-a145-7754255ba278 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:18.419787 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-33b95a76-0c1b-4b86-a145-7754255ba278 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:18.550928 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-33b95a76-0c1b-4b86-a145-7754255ba278 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:18.558905 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-33b95a76-0c1b-4b86-a145-7754255ba278 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:18.560483 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-33b95a76-0c1b-4b86-a145-7754255ba278 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:18.561709 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-33b95a76-0c1b-4b86-a145-7754255ba278 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.156245 May 26 13:57:18.562384 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 124/228] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:57:18 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:57:18.871063 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f7aea5e6-b7ea-4692-b39c-7d799ae7d262 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:18.871668 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f7aea5e6-b7ea-4692-b39c-7d799ae7d262 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:18.873550 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:18.878940 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f7aea5e6-b7ea-4692-b39c-7d799ae7d262 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:18.879391 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f7aea5e6-b7ea-4692-b39c-7d799ae7d262 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:18.880152 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f7aea5e6-b7ea-4692-b39c-7d799ae7d262 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:18.880589 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f7aea5e6-b7ea-4692-b39c-7d799ae7d262 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:19.003967 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f7aea5e6-b7ea-4692-b39c-7d799ae7d262 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:19.011403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f7aea5e6-b7ea-4692-b39c-7d799ae7d262 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.144250 May 26 13:57:19.012461 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 125/229] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:18 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:19.408759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8a2f0f8e-18b9-4744-9807-cc6b013be9c5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:19.409542 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8a2f0f8e-18b9-4744-9807-cc6b013be9c5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:19.416237 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8a2f0f8e-18b9-4744-9807-cc6b013be9c5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:19.417305 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8a2f0f8e-18b9-4744-9807-cc6b013be9c5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:19.418218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8a2f0f8e-18b9-4744-9807-cc6b013be9c5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:19.418793 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8a2f0f8e-18b9-4744-9807-cc6b013be9c5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:19.553802 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8a2f0f8e-18b9-4744-9807-cc6b013be9c5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:19.561749 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8a2f0f8e-18b9-4744-9807-cc6b013be9c5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.157400 May 26 13:57:19.562324 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 126/230] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:19 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:19.579095 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6c0e3fc9-0dbf-457a-af80-9c225a6a07be tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:19.579701 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6c0e3fc9-0dbf-457a-af80-9c225a6a07be tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:19.585829 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c0e3fc9-0dbf-457a-af80-9c225a6a07be tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:19.586270 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c0e3fc9-0dbf-457a-af80-9c225a6a07be tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:19.587042 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c0e3fc9-0dbf-457a-af80-9c225a6a07be tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:19.587479 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c0e3fc9-0dbf-457a-af80-9c225a6a07be tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:19.725914 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6c0e3fc9-0dbf-457a-af80-9c225a6a07be tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:19.734790 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6c0e3fc9-0dbf-457a-af80-9c225a6a07be tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:19.736367 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6c0e3fc9-0dbf-457a-af80-9c225a6a07be tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:19.737467 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6c0e3fc9-0dbf-457a-af80-9c225a6a07be tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.162130 May 26 13:57:19.738048 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 127/231] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:57:19 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:57:20.028015 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c1601be6-3e73-4232-9b17-b1711d3c2ea8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:20.029362 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c1601be6-3e73-4232-9b17-b1711d3c2ea8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:20.036478 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c1601be6-3e73-4232-9b17-b1711d3c2ea8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:20.037249 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c1601be6-3e73-4232-9b17-b1711d3c2ea8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:20.038080 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c1601be6-3e73-4232-9b17-b1711d3c2ea8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:20.038617 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c1601be6-3e73-4232-9b17-b1711d3c2ea8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:20.428206 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c1601be6-3e73-4232-9b17-b1711d3c2ea8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:20.436922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c1601be6-3e73-4232-9b17-b1711d3c2ea8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.412791 May 26 13:57:20.438389 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 128/232] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:20 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:20.579500 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d34eb776-834c-43c3-a309-f48bd512cee5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:20.580108 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d34eb776-834c-43c3-a309-f48bd512cee5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:20.586330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d34eb776-834c-43c3-a309-f48bd512cee5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:20.586778 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d34eb776-834c-43c3-a309-f48bd512cee5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:20.587546 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d34eb776-834c-43c3-a309-f48bd512cee5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:20.587983 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d34eb776-834c-43c3-a309-f48bd512cee5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:20.753419 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d34eb776-834c-43c3-a309-f48bd512cee5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:20.761649 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d34eb776-834c-43c3-a309-f48bd512cee5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.186497 May 26 13:57:20.762380 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 129/233] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:20 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:20.767552 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-28a04578-4c10-4bf2-b384-d02515900c46 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:20.768453 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-28a04578-4c10-4bf2-b384-d02515900c46 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:20.775845 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28a04578-4c10-4bf2-b384-d02515900c46 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:20.776436 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28a04578-4c10-4bf2-b384-d02515900c46 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:20.777628 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28a04578-4c10-4bf2-b384-d02515900c46 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:20.778153 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28a04578-4c10-4bf2-b384-d02515900c46 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:20.938270 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-28a04578-4c10-4bf2-b384-d02515900c46 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:20.951984 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-28a04578-4c10-4bf2-b384-d02515900c46 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:20.951984 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-28a04578-4c10-4bf2-b384-d02515900c46 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:20.951984 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-28a04578-4c10-4bf2-b384-d02515900c46 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.187530 May 26 13:57:20.952392 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 130/234] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:57:20 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:57:21.455315 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-819b89d9-82e6-4269-a25a-0cb45a6e8673 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:21.456533 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-819b89d9-82e6-4269-a25a-0cb45a6e8673 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:21.467639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-819b89d9-82e6-4269-a25a-0cb45a6e8673 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:21.469002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-819b89d9-82e6-4269-a25a-0cb45a6e8673 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:21.471062 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-819b89d9-82e6-4269-a25a-0cb45a6e8673 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:21.472085 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-819b89d9-82e6-4269-a25a-0cb45a6e8673 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:21.686728 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-819b89d9-82e6-4269-a25a-0cb45a6e8673 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:21.697805 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-819b89d9-82e6-4269-a25a-0cb45a6e8673 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.247659 May 26 13:57:21.698391 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 131/235] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:21 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:21.703903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-9f2084ef-bab1-4d61-ae4d-275d7b25c372 req-f1346e2c-7485-4d8c-a43a-7b56215e5148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e953c9eb-adb5-49a2-b9c2-03633d118240", "name": "network-vif-plugged", "status": "completed", "tag": "9ea477a5-0b77-466c-b782-069bc53617e5"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:57:21.712188 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-9f2084ef-bab1-4d61-ae4d-275d7b25c372 req-f1346e2c-7485-4d8c-a43a-7b56215e5148 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:21.712637 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-9f2084ef-bab1-4d61-ae4d-275d7b25c372 req-f1346e2c-7485-4d8c-a43a-7b56215e5148 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:21.724567 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-9f2084ef-bab1-4d61-ae4d-275d7b25c372 req-f1346e2c-7485-4d8c-a43a-7b56215e5148 service nova] Creating event network-vif-plugged:9ea477a5-0b77-466c-b782-069bc53617e5 for instance e953c9eb-adb5-49a2-b9c2-03633d118240 on hv-cinder-84213 May 26 13:57:21.729886 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-9f2084ef-bab1-4d61-ae4d-275d7b25c372 req-f1346e2c-7485-4d8c-a43a-7b56215e5148 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030327 May 26 13:57:21.730608 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 132/236] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 13:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:57:21.781779 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-476ec6d0-cb9c-4fc8-b32b-e312ac694942 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:21.782555 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-476ec6d0-cb9c-4fc8-b32b-e312ac694942 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:21.788912 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-476ec6d0-cb9c-4fc8-b32b-e312ac694942 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:21.789465 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-476ec6d0-cb9c-4fc8-b32b-e312ac694942 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:21.790313 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-476ec6d0-cb9c-4fc8-b32b-e312ac694942 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:21.790816 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-476ec6d0-cb9c-4fc8-b32b-e312ac694942 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:21.928873 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-476ec6d0-cb9c-4fc8-b32b-e312ac694942 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:21.937039 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-476ec6d0-cb9c-4fc8-b32b-e312ac694942 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.160662 May 26 13:57:21.937722 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 133/237] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:21 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:21.968487 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f5092e74-d808-45c9-9de8-94b323fee9b9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:21.969098 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f5092e74-d808-45c9-9de8-94b323fee9b9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:21.975459 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f5092e74-d808-45c9-9de8-94b323fee9b9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:21.975919 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f5092e74-d808-45c9-9de8-94b323fee9b9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:21.976724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f5092e74-d808-45c9-9de8-94b323fee9b9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:21.977184 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f5092e74-d808-45c9-9de8-94b323fee9b9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:22.113492 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f5092e74-d808-45c9-9de8-94b323fee9b9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:22.122039 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f5092e74-d808-45c9-9de8-94b323fee9b9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:22.124490 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f5092e74-d808-45c9-9de8-94b323fee9b9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:22.126085 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f5092e74-d808-45c9-9de8-94b323fee9b9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.161410 May 26 13:57:22.126688 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 134/238] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:57:21 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:57:22.720067 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-eb9281e5-f5ab-4a21-8316-1ad336055d33 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:22.720701 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-eb9281e5-f5ab-4a21-8316-1ad336055d33 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:22.726895 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb9281e5-f5ab-4a21-8316-1ad336055d33 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:22.727341 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb9281e5-f5ab-4a21-8316-1ad336055d33 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:22.728102 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb9281e5-f5ab-4a21-8316-1ad336055d33 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:22.728534 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb9281e5-f5ab-4a21-8316-1ad336055d33 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:22.861673 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-eb9281e5-f5ab-4a21-8316-1ad336055d33 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:22.869062 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-eb9281e5-f5ab-4a21-8316-1ad336055d33 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.152984 May 26 13:57:22.869738 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 135/239] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:22 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:22.954454 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-15d34b1a-9fc0-46d3-9e3d-6591d2618e79 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:22.954970 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-15d34b1a-9fc0-46d3-9e3d-6591d2618e79 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:22.962117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-15d34b1a-9fc0-46d3-9e3d-6591d2618e79 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:22.962347 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-15d34b1a-9fc0-46d3-9e3d-6591d2618e79 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:22.963165 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-15d34b1a-9fc0-46d3-9e3d-6591d2618e79 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:22.963618 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-15d34b1a-9fc0-46d3-9e3d-6591d2618e79 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:23.096471 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-15d34b1a-9fc0-46d3-9e3d-6591d2618e79 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:23.103893 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-15d34b1a-9fc0-46d3-9e3d-6591d2618e79 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.154045 May 26 13:57:23.104453 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 136/240] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:22 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:23.143655 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f01af7e9-30c7-4cb8-9dec-fd00646cc37d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:23.144263 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f01af7e9-30c7-4cb8-9dec-fd00646cc37d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:23.150271 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f01af7e9-30c7-4cb8-9dec-fd00646cc37d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:23.150728 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f01af7e9-30c7-4cb8-9dec-fd00646cc37d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:23.151488 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f01af7e9-30c7-4cb8-9dec-fd00646cc37d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:23.152188 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f01af7e9-30c7-4cb8-9dec-fd00646cc37d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:23.170469 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:23.290323 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f01af7e9-30c7-4cb8-9dec-fd00646cc37d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:23.298880 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f01af7e9-30c7-4cb8-9dec-fd00646cc37d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:23.300493 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f01af7e9-30c7-4cb8-9dec-fd00646cc37d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:23.301616 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f01af7e9-30c7-4cb8-9dec-fd00646cc37d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.161792 May 26 13:57:23.302172 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 137/241] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:57:23 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:57:23.846587 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=61 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:23.887103 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0dd97f05-1f42-490c-aa34-45144b3fc22c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:23.888212 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0dd97f05-1f42-490c-aa34-45144b3fc22c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:23.897769 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0dd97f05-1f42-490c-aa34-45144b3fc22c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:23.898216 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0dd97f05-1f42-490c-aa34-45144b3fc22c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:23.898977 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0dd97f05-1f42-490c-aa34-45144b3fc22c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:23.899407 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0dd97f05-1f42-490c-aa34-45144b3fc22c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:23.943182 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=31 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:24.042964 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0dd97f05-1f42-490c-aa34-45144b3fc22c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:24.050573 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0dd97f05-1f42-490c-aa34-45144b3fc22c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.168259 May 26 13:57:24.051152 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 138/242] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:23 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:24.120896 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2e311ea5-3080-4561-8593-6bdeadfddf37 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:24.121501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2e311ea5-3080-4561-8593-6bdeadfddf37 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:24.127522 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2e311ea5-3080-4561-8593-6bdeadfddf37 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:24.128155 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2e311ea5-3080-4561-8593-6bdeadfddf37 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:24.128919 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2e311ea5-3080-4561-8593-6bdeadfddf37 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:24.129379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2e311ea5-3080-4561-8593-6bdeadfddf37 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:24.268522 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2e311ea5-3080-4561-8593-6bdeadfddf37 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:24.276110 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2e311ea5-3080-4561-8593-6bdeadfddf37 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.159050 May 26 13:57:24.276678 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 139/243] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:24 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:24.320596 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ac438a37-953c-46c4-9bd5-e2d19fd00c89 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:24.321241 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ac438a37-953c-46c4-9bd5-e2d19fd00c89 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:24.327910 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac438a37-953c-46c4-9bd5-e2d19fd00c89 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:24.328355 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac438a37-953c-46c4-9bd5-e2d19fd00c89 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:24.329238 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac438a37-953c-46c4-9bd5-e2d19fd00c89 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:24.329556 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac438a37-953c-46c4-9bd5-e2d19fd00c89 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:24.463325 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ac438a37-953c-46c4-9bd5-e2d19fd00c89 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:24.471957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ac438a37-953c-46c4-9bd5-e2d19fd00c89 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:24.473654 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ac438a37-953c-46c4-9bd5-e2d19fd00c89 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:24.474558 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ac438a37-953c-46c4-9bd5-e2d19fd00c89 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.158820 May 26 13:57:24.475317 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 140/244] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:57:24 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:57:25.066415 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9e88163e-7ef7-4b7b-82b4-d6aacc86c075 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:25.067088 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9e88163e-7ef7-4b7b-82b4-d6aacc86c075 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:25.073164 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9e88163e-7ef7-4b7b-82b4-d6aacc86c075 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:25.073627 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9e88163e-7ef7-4b7b-82b4-d6aacc86c075 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:25.074392 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9e88163e-7ef7-4b7b-82b4-d6aacc86c075 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:25.074829 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9e88163e-7ef7-4b7b-82b4-d6aacc86c075 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:25.212691 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9e88163e-7ef7-4b7b-82b4-d6aacc86c075 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:25.220786 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9e88163e-7ef7-4b7b-82b4-d6aacc86c075 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.158112 May 26 13:57:25.221375 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 141/245] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:25 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:25.293260 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-93d3042c-eeab-451d-aa4f-6f68277e137b tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:25.294610 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-93d3042c-eeab-451d-aa4f-6f68277e137b tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:25.300722 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-93d3042c-eeab-451d-aa4f-6f68277e137b tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:25.301178 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-93d3042c-eeab-451d-aa4f-6f68277e137b tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:25.301984 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-93d3042c-eeab-451d-aa4f-6f68277e137b tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:25.302418 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-93d3042c-eeab-451d-aa4f-6f68277e137b tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:25.476207 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-93d3042c-eeab-451d-aa4f-6f68277e137b tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:25.484101 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-93d3042c-eeab-451d-aa4f-6f68277e137b tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.194588 May 26 13:57:25.484670 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 142/246] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:25 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:25.498790 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4658ce4a-01e7-4344-ab14-d135b95da9b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:25.499335 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4658ce4a-01e7-4344-ab14-d135b95da9b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:25.505586 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4658ce4a-01e7-4344-ab14-d135b95da9b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:25.506065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4658ce4a-01e7-4344-ab14-d135b95da9b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:25.506829 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4658ce4a-01e7-4344-ab14-d135b95da9b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:25.507260 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4658ce4a-01e7-4344-ab14-d135b95da9b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:25.670005 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4658ce4a-01e7-4344-ab14-d135b95da9b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:25.677948 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4658ce4a-01e7-4344-ab14-d135b95da9b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:25.679737 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4658ce4a-01e7-4344-ab14-d135b95da9b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:25.680862 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4658ce4a-01e7-4344-ab14-d135b95da9b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.191993 May 26 13:57:25.689130 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 143/247] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:57:25 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:57:26.237599 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d2c8249f-715a-4494-8b11-40a20dd251ec tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:26.238278 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d2c8249f-715a-4494-8b11-40a20dd251ec tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:26.244843 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2c8249f-715a-4494-8b11-40a20dd251ec tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:26.245268 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2c8249f-715a-4494-8b11-40a20dd251ec tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:26.246041 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2c8249f-715a-4494-8b11-40a20dd251ec tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:26.246461 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2c8249f-715a-4494-8b11-40a20dd251ec tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:26.388386 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d2c8249f-715a-4494-8b11-40a20dd251ec tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:26.395758 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d2c8249f-715a-4494-8b11-40a20dd251ec tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.162001 May 26 13:57:26.396318 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 144/248] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:26 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:26.500742 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d4df87a9-369a-4eaf-85f3-9d594407ccf1 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:26.501527 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d4df87a9-369a-4eaf-85f3-9d594407ccf1 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:26.508075 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d4df87a9-369a-4eaf-85f3-9d594407ccf1 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:26.508621 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d4df87a9-369a-4eaf-85f3-9d594407ccf1 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:26.509476 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d4df87a9-369a-4eaf-85f3-9d594407ccf1 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:26.509980 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d4df87a9-369a-4eaf-85f3-9d594407ccf1 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:26.642618 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d4df87a9-369a-4eaf-85f3-9d594407ccf1 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:26.650441 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d4df87a9-369a-4eaf-85f3-9d594407ccf1 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.153468 May 26 13:57:26.651045 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 145/249] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:26 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:26.699505 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ea7ca05f-2ed2-4ac4-bbca-872966e8167d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:26.699991 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ea7ca05f-2ed2-4ac4-bbca-872966e8167d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:26.706472 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ea7ca05f-2ed2-4ac4-bbca-872966e8167d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:26.706923 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ea7ca05f-2ed2-4ac4-bbca-872966e8167d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:26.707693 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ea7ca05f-2ed2-4ac4-bbca-872966e8167d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:26.708128 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ea7ca05f-2ed2-4ac4-bbca-872966e8167d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:26.853557 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ea7ca05f-2ed2-4ac4-bbca-872966e8167d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:26.861389 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ea7ca05f-2ed2-4ac4-bbca-872966e8167d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:26.862881 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ea7ca05f-2ed2-4ac4-bbca-872966e8167d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:26.863966 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ea7ca05f-2ed2-4ac4-bbca-872966e8167d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1407 microversion: 2.20 time: 0.169219 May 26 13:57:26.864506 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 146/250] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:57:26 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:57:27.413192 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e80cfe76-217d-4b84-9935-9cb1bcdab753 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:27.413926 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e80cfe76-217d-4b84-9935-9cb1bcdab753 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:27.420212 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e80cfe76-217d-4b84-9935-9cb1bcdab753 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:27.420726 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e80cfe76-217d-4b84-9935-9cb1bcdab753 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:27.421578 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e80cfe76-217d-4b84-9935-9cb1bcdab753 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:27.422101 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e80cfe76-217d-4b84-9935-9cb1bcdab753 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:27.562326 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e80cfe76-217d-4b84-9935-9cb1bcdab753 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:27.570487 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e80cfe76-217d-4b84-9935-9cb1bcdab753 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.161105 May 26 13:57:27.571385 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 147/251] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:27 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:27.667867 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-78714e54-207f-4645-9ea4-f52241bf37b5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:27.668602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-78714e54-207f-4645-9ea4-f52241bf37b5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:27.675420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-78714e54-207f-4645-9ea4-f52241bf37b5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:27.675944 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-78714e54-207f-4645-9ea4-f52241bf37b5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:27.676814 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-78714e54-207f-4645-9ea4-f52241bf37b5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:27.677377 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-78714e54-207f-4645-9ea4-f52241bf37b5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:27.833311 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-78714e54-207f-4645-9ea4-f52241bf37b5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:27.841340 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-78714e54-207f-4645-9ea4-f52241bf37b5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.177276 May 26 13:57:27.841837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 148/252] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:27 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:27.881552 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2043245d-3862-485f-b010-64c51cd6c1fe tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:27.882143 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2043245d-3862-485f-b010-64c51cd6c1fe tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:27.888017 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2043245d-3862-485f-b010-64c51cd6c1fe tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:27.888456 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2043245d-3862-485f-b010-64c51cd6c1fe tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:27.889229 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2043245d-3862-485f-b010-64c51cd6c1fe tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:27.889656 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2043245d-3862-485f-b010-64c51cd6c1fe tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:28.030221 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2043245d-3862-485f-b010-64c51cd6c1fe tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:28.040641 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2043245d-3862-485f-b010-64c51cd6c1fe tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:28.042259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2043245d-3862-485f-b010-64c51cd6c1fe tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:28.044911 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2043245d-3862-485f-b010-64c51cd6c1fe tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1599 microversion: 2.20 time: 0.167217 May 26 13:57:28.045505 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 149/253] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 13:57:27 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1599 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:57:28.063769 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-72002057-0a95-491b-9568-f013660bf51c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:28.064297 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-72002057-0a95-491b-9568-f013660bf51c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:28.071050 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-72002057-0a95-491b-9568-f013660bf51c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:28.071507 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-72002057-0a95-491b-9568-f013660bf51c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:28.072264 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-72002057-0a95-491b-9568-f013660bf51c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:28.072687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-72002057-0a95-491b-9568-f013660bf51c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:28.192134 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-72002057-0a95-491b-9568-f013660bf51c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.132584 May 26 13:57:28.192989 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 150/254] 10.222.0.91 () {60 vars in 1315 bytes} [Thu May 26 13:57:28 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 13:57:28.587925 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3bcd8a13-6639-4e22-81ab-232f34870281 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:28.588590 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3bcd8a13-6639-4e22-81ab-232f34870281 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:28.595664 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3bcd8a13-6639-4e22-81ab-232f34870281 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:28.596381 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3bcd8a13-6639-4e22-81ab-232f34870281 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:28.597729 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3bcd8a13-6639-4e22-81ab-232f34870281 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:28.598457 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3bcd8a13-6639-4e22-81ab-232f34870281 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:28.719629 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5ce76cc1-1548-4794-9108-d1bc8e32fb2c tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "POST /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.866319 May 26 13:57:28.720323 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 105/255] 10.222.0.91 () {60 vars in 1322 bytes} [Thu May 26 13:57:13 2022] POST /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce/os-volume_attachments => generated 194 bytes in 14884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:57:28.859479 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-beead053-b61f-41c6-b6cf-e0396a5b823c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:28.860190 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-beead053-b61f-41c6-b6cf-e0396a5b823c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:28.871605 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-beead053-b61f-41c6-b6cf-e0396a5b823c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:28.873264 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-beead053-b61f-41c6-b6cf-e0396a5b823c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:28.875373 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-beead053-b61f-41c6-b6cf-e0396a5b823c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:28.877282 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-beead053-b61f-41c6-b6cf-e0396a5b823c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:29.077983 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3bcd8a13-6639-4e22-81ab-232f34870281 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:29.085663 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3bcd8a13-6639-4e22-81ab-232f34870281 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.502106 May 26 13:57:29.086228 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 151/256] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:28 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:29.295079 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-beead053-b61f-41c6-b6cf-e0396a5b823c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:29.302930 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-beead053-b61f-41c6-b6cf-e0396a5b823c tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.448518 May 26 13:57:29.303640 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 106/257] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:28 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:29.780702 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-53ced48e-d7f4-4766-9000-307a779b4d20 req-663a21ea-dd24-4aa9-aebd-428dd2164853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9116ee60-50e6-48c5-bcc1-8e9d08e35458", "tag": "0d486a1e-7691-438f-a89c-df9425b682f1"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:57:29.795481 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-53ced48e-d7f4-4766-9000-307a779b4d20 req-663a21ea-dd24-4aa9-aebd-428dd2164853 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:29.796371 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-53ced48e-d7f4-4766-9000-307a779b4d20 req-663a21ea-dd24-4aa9-aebd-428dd2164853 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:29.813970 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-53ced48e-d7f4-4766-9000-307a779b4d20 req-663a21ea-dd24-4aa9-aebd-428dd2164853 service nova] Creating event network-changed:0d486a1e-7691-438f-a89c-df9425b682f1 for instance 9116ee60-50e6-48c5-bcc1-8e9d08e35458 on hv-cinder-84213 May 26 13:57:29.819651 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-53ced48e-d7f4-4766-9000-307a779b4d20 req-663a21ea-dd24-4aa9-aebd-428dd2164853 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045098 May 26 13:57:29.820996 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 152/258] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 13:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:57:30.102477 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-32232ac5-62af-492c-b89b-c2abc29b05d4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:30.103258 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-32232ac5-62af-492c-b89b-c2abc29b05d4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:30.110756 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-32232ac5-62af-492c-b89b-c2abc29b05d4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:30.111319 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-32232ac5-62af-492c-b89b-c2abc29b05d4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:30.112193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-32232ac5-62af-492c-b89b-c2abc29b05d4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:30.112963 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-32232ac5-62af-492c-b89b-c2abc29b05d4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:30.290642 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-32232ac5-62af-492c-b89b-c2abc29b05d4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:30.310978 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-32232ac5-62af-492c-b89b-c2abc29b05d4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.204364 May 26 13:57:30.310978 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 107/259] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:30 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:30.324535 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-eb52351f-15fd-4b18-8378-d688f5fb61e5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:30.326172 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-eb52351f-15fd-4b18-8378-d688f5fb61e5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:30.333037 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb52351f-15fd-4b18-8378-d688f5fb61e5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:30.333601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb52351f-15fd-4b18-8378-d688f5fb61e5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:30.334431 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb52351f-15fd-4b18-8378-d688f5fb61e5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:30.334929 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb52351f-15fd-4b18-8378-d688f5fb61e5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:30.531480 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-eb52351f-15fd-4b18-8378-d688f5fb61e5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:30.542447 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-eb52351f-15fd-4b18-8378-d688f5fb61e5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.223589 May 26 13:57:30.543029 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 153/260] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:30 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:31.320062 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9e998a24-e558-4814-bccb-b935c932f4e6 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:31.320528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9e998a24-e558-4814-bccb-b935c932f4e6 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:31.327136 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9e998a24-e558-4814-bccb-b935c932f4e6 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:31.327581 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9e998a24-e558-4814-bccb-b935c932f4e6 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:31.328339 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9e998a24-e558-4814-bccb-b935c932f4e6 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:31.328767 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9e998a24-e558-4814-bccb-b935c932f4e6 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:31.458571 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9e998a24-e558-4814-bccb-b935c932f4e6 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:31.466172 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9e998a24-e558-4814-bccb-b935c932f4e6 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.150032 May 26 13:57:31.466772 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 108/261] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:31 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:31.559988 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b8b9a866-fde7-4136-9de5-1b58507012d6 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:31.560617 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b8b9a866-fde7-4136-9de5-1b58507012d6 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:31.567069 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b8b9a866-fde7-4136-9de5-1b58507012d6 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:31.567523 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b8b9a866-fde7-4136-9de5-1b58507012d6 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:31.568294 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b8b9a866-fde7-4136-9de5-1b58507012d6 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:31.568727 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b8b9a866-fde7-4136-9de5-1b58507012d6 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:31.697254 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b8b9a866-fde7-4136-9de5-1b58507012d6 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:31.711497 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b8b9a866-fde7-4136-9de5-1b58507012d6 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.149613 May 26 13:57:31.711497 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 154/262] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:31 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:32.482771 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b931d7e2-30ea-4761-b1ca-71d23b38e1a5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:32.483377 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b931d7e2-30ea-4761-b1ca-71d23b38e1a5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:32.489835 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b931d7e2-30ea-4761-b1ca-71d23b38e1a5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:32.490291 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b931d7e2-30ea-4761-b1ca-71d23b38e1a5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:32.491050 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b931d7e2-30ea-4761-b1ca-71d23b38e1a5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:32.491486 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b931d7e2-30ea-4761-b1ca-71d23b38e1a5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:32.620290 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b931d7e2-30ea-4761-b1ca-71d23b38e1a5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:32.628114 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b931d7e2-30ea-4761-b1ca-71d23b38e1a5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.149192 May 26 13:57:32.628686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 109/263] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:32 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:32.721420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f626106d-6ed3-4fe3-8461-36a0b4f238f0 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:32.722022 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f626106d-6ed3-4fe3-8461-36a0b4f238f0 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:32.728052 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f626106d-6ed3-4fe3-8461-36a0b4f238f0 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:32.728503 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f626106d-6ed3-4fe3-8461-36a0b4f238f0 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:32.729281 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f626106d-6ed3-4fe3-8461-36a0b4f238f0 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:32.729710 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f626106d-6ed3-4fe3-8461-36a0b4f238f0 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:32.733804 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:32.853270 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f626106d-6ed3-4fe3-8461-36a0b4f238f0 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:32.861071 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f626106d-6ed3-4fe3-8461-36a0b4f238f0 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.143551 May 26 13:57:32.861663 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 155/264] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:32 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:33.644873 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f1bb342f-d313-4ff5-8390-a011cecf558f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:33.645506 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f1bb342f-d313-4ff5-8390-a011cecf558f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:33.652131 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f1bb342f-d313-4ff5-8390-a011cecf558f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:33.652575 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f1bb342f-d313-4ff5-8390-a011cecf558f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:33.653364 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f1bb342f-d313-4ff5-8390-a011cecf558f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:33.653798 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f1bb342f-d313-4ff5-8390-a011cecf558f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:33.783375 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f1bb342f-d313-4ff5-8390-a011cecf558f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:33.790871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f1bb342f-d313-4ff5-8390-a011cecf558f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.149855 May 26 13:57:33.791443 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 110/265] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:33 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:33.878321 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b1d6cc3d-10cf-46a0-9f93-11ae89c2fb7b tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:33.878920 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b1d6cc3d-10cf-46a0-9f93-11ae89c2fb7b tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:33.884930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b1d6cc3d-10cf-46a0-9f93-11ae89c2fb7b tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:33.885409 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b1d6cc3d-10cf-46a0-9f93-11ae89c2fb7b tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:33.886168 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b1d6cc3d-10cf-46a0-9f93-11ae89c2fb7b tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:33.886603 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b1d6cc3d-10cf-46a0-9f93-11ae89c2fb7b tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:34.019328 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b1d6cc3d-10cf-46a0-9f93-11ae89c2fb7b tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:34.028886 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b1d6cc3d-10cf-46a0-9f93-11ae89c2fb7b tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.153858 May 26 13:57:34.029496 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 156/266] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:33 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:34.808041 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d5321bbb-e554-479d-90d5-4936840d5e55 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:34.808638 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d5321bbb-e554-479d-90d5-4936840d5e55 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:34.815748 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d5321bbb-e554-479d-90d5-4936840d5e55 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:34.816198 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d5321bbb-e554-479d-90d5-4936840d5e55 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:34.816962 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d5321bbb-e554-479d-90d5-4936840d5e55 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:34.817421 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d5321bbb-e554-479d-90d5-4936840d5e55 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:34.945910 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d5321bbb-e554-479d-90d5-4936840d5e55 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:34.953895 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d5321bbb-e554-479d-90d5-4936840d5e55 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.149722 May 26 13:57:34.954465 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 111/267] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:34 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:35.045214 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-14b0297e-eb00-4904-b506-362a9029bd08 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:35.045816 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-14b0297e-eb00-4904-b506-362a9029bd08 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:35.051849 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-14b0297e-eb00-4904-b506-362a9029bd08 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:35.052293 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-14b0297e-eb00-4904-b506-362a9029bd08 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:35.053037 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-14b0297e-eb00-4904-b506-362a9029bd08 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:35.053492 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-14b0297e-eb00-4904-b506-362a9029bd08 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:35.195007 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-14b0297e-eb00-4904-b506-362a9029bd08 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:35.202581 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-14b0297e-eb00-4904-b506-362a9029bd08 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.161834 May 26 13:57:35.203149 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 157/268] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:35 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:35.971222 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6db06bd1-04dc-403d-9bd8-647b5658af89 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:35.972300 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6db06bd1-04dc-403d-9bd8-647b5658af89 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:35.980244 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6db06bd1-04dc-403d-9bd8-647b5658af89 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:35.981061 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6db06bd1-04dc-403d-9bd8-647b5658af89 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:35.982452 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6db06bd1-04dc-403d-9bd8-647b5658af89 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:35.983114 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6db06bd1-04dc-403d-9bd8-647b5658af89 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:36.220412 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0bbf9701-3804-44a4-8a71-d3c3409b3cda tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:36.221025 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0bbf9701-3804-44a4-8a71-d3c3409b3cda tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:36.227693 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0bbf9701-3804-44a4-8a71-d3c3409b3cda tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:36.228146 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0bbf9701-3804-44a4-8a71-d3c3409b3cda tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:36.228911 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0bbf9701-3804-44a4-8a71-d3c3409b3cda tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:36.229389 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0bbf9701-3804-44a4-8a71-d3c3409b3cda tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:36.420068 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6db06bd1-04dc-403d-9bd8-647b5658af89 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:36.423970 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0bbf9701-3804-44a4-8a71-d3c3409b3cda tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:36.427503 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6db06bd1-04dc-403d-9bd8-647b5658af89 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.460152 May 26 13:57:36.428161 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 112/269] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:35 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:36.431511 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0bbf9701-3804-44a4-8a71-d3c3409b3cda tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.216184 May 26 13:57:36.432059 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 158/270] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:36 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:37.446682 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d4de1147-5299-4500-8a57-1d9779702e34 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:37.448027 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d4de1147-5299-4500-8a57-1d9779702e34 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:37.448411 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8cf97cc0-ded7-4d60-8a88-69ef0ae3f826 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:37.449203 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8cf97cc0-ded7-4d60-8a88-69ef0ae3f826 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:37.461405 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d4de1147-5299-4500-8a57-1d9779702e34 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:37.462123 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d4de1147-5299-4500-8a57-1d9779702e34 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:37.463512 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d4de1147-5299-4500-8a57-1d9779702e34 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:37.465765 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d4de1147-5299-4500-8a57-1d9779702e34 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:37.472262 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8cf97cc0-ded7-4d60-8a88-69ef0ae3f826 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:37.472858 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8cf97cc0-ded7-4d60-8a88-69ef0ae3f826 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:37.474074 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8cf97cc0-ded7-4d60-8a88-69ef0ae3f826 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:37.474644 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8cf97cc0-ded7-4d60-8a88-69ef0ae3f826 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:37.715613 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d4de1147-5299-4500-8a57-1d9779702e34 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:37.727398 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8cf97cc0-ded7-4d60-8a88-69ef0ae3f826 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:37.730559 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d4de1147-5299-4500-8a57-1d9779702e34 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.288783 May 26 13:57:37.731614 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 113/271] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:37 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:37.736958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8cf97cc0-ded7-4d60-8a88-69ef0ae3f826 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.292846 May 26 13:57:37.737862 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 159/272] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:37 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:38.748128 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ec0b721b-3389-4dcc-9c31-57ddff871373 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:38.748899 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ec0b721b-3389-4dcc-9c31-57ddff871373 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:38.754239 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-57ac0fca-d5f0-478d-8af6-0ee28032ecf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:38.754847 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-57ac0fca-d5f0-478d-8af6-0ee28032ecf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:38.755917 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ec0b721b-3389-4dcc-9c31-57ddff871373 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:38.756431 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ec0b721b-3389-4dcc-9c31-57ddff871373 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:38.757447 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ec0b721b-3389-4dcc-9c31-57ddff871373 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:38.758076 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ec0b721b-3389-4dcc-9c31-57ddff871373 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:38.761980 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-57ac0fca-d5f0-478d-8af6-0ee28032ecf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:38.763661 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-57ac0fca-d5f0-478d-8af6-0ee28032ecf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:38.763661 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-57ac0fca-d5f0-478d-8af6-0ee28032ecf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:38.763891 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-57ac0fca-d5f0-478d-8af6-0ee28032ecf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:38.974473 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ec0b721b-3389-4dcc-9c31-57ddff871373 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:38.982538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ec0b721b-3389-4dcc-9c31-57ddff871373 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.238155 May 26 13:57:38.985100 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 114/273] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:38 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:39.005509 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-57ac0fca-d5f0-478d-8af6-0ee28032ecf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:39.015271 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-57ac0fca-d5f0-478d-8af6-0ee28032ecf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.265097 May 26 13:57:39.026741 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 160/274] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:38 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:40.003941 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-27a3c668-553f-43c0-95fb-18e9dc5d8422 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:40.009141 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-27a3c668-553f-43c0-95fb-18e9dc5d8422 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:40.033768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-49328835-e911-49e4-8a4d-f67b4a85a377 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:40.034470 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-49328835-e911-49e4-8a4d-f67b4a85a377 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:40.042773 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-49328835-e911-49e4-8a4d-f67b4a85a377 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:40.043621 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-49328835-e911-49e4-8a4d-f67b4a85a377 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:40.045236 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-49328835-e911-49e4-8a4d-f67b4a85a377 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:40.045888 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-49328835-e911-49e4-8a4d-f67b4a85a377 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:40.050291 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-27a3c668-553f-43c0-95fb-18e9dc5d8422 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:40.052522 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-27a3c668-553f-43c0-95fb-18e9dc5d8422 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:40.053625 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-27a3c668-553f-43c0-95fb-18e9dc5d8422 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:40.055697 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-27a3c668-553f-43c0-95fb-18e9dc5d8422 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:40.314000 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-27a3c668-553f-43c0-95fb-18e9dc5d8422 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:40.316036 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-49328835-e911-49e4-8a4d-f67b4a85a377 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:40.323753 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-27a3c668-553f-43c0-95fb-18e9dc5d8422 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.323553 May 26 13:57:40.324544 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-49328835-e911-49e4-8a4d-f67b4a85a377 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.294974 May 26 13:57:40.333825 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 115/275] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:39 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:40.335618 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 161/276] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:40 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:41.341039 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e46e5295-c2b8-4bff-88b6-f09ded3f7a1f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:41.341846 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e46e5295-c2b8-4bff-88b6-f09ded3f7a1f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:41.348919 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e46e5295-c2b8-4bff-88b6-f09ded3f7a1f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:41.349598 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e46e5295-c2b8-4bff-88b6-f09ded3f7a1f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:41.350561 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e46e5295-c2b8-4bff-88b6-f09ded3f7a1f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:41.351152 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e46e5295-c2b8-4bff-88b6-f09ded3f7a1f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:41.355237 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7f155ef1-4018-4d50-9a5b-6de58c346bf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:41.356047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7f155ef1-4018-4d50-9a5b-6de58c346bf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:41.363760 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f155ef1-4018-4d50-9a5b-6de58c346bf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:41.364612 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f155ef1-4018-4d50-9a5b-6de58c346bf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:41.365468 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f155ef1-4018-4d50-9a5b-6de58c346bf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:41.366129 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f155ef1-4018-4d50-9a5b-6de58c346bf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:41.615743 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e46e5295-c2b8-4bff-88b6-f09ded3f7a1f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:41.618935 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7f155ef1-4018-4d50-9a5b-6de58c346bf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:41.625029 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e46e5295-c2b8-4bff-88b6-f09ded3f7a1f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.288369 May 26 13:57:41.625802 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 116/277] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:41 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:41.627840 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7f155ef1-4018-4d50-9a5b-6de58c346bf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.280609 May 26 13:57:41.628574 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 162/278] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:41 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:42.642385 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0056408a-69cf-4bee-a84f-b9a8012cc144 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:42.642990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0056408a-69cf-4bee-a84f-b9a8012cc144 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:42.643853 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-bbca36bc-2b2a-4efa-92c2-3ffd6870c175 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:42.644529 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-bbca36bc-2b2a-4efa-92c2-3ffd6870c175 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:42.649502 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0056408a-69cf-4bee-a84f-b9a8012cc144 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:42.649948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0056408a-69cf-4bee-a84f-b9a8012cc144 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:42.650600 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bbca36bc-2b2a-4efa-92c2-3ffd6870c175 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:42.650711 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0056408a-69cf-4bee-a84f-b9a8012cc144 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:42.651042 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bbca36bc-2b2a-4efa-92c2-3ffd6870c175 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:42.651159 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0056408a-69cf-4bee-a84f-b9a8012cc144 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:42.652052 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bbca36bc-2b2a-4efa-92c2-3ffd6870c175 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:42.652479 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bbca36bc-2b2a-4efa-92c2-3ffd6870c175 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:42.844349 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bbca36bc-2b2a-4efa-92c2-3ffd6870c175 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:42.847336 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0056408a-69cf-4bee-a84f-b9a8012cc144 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:42.851773 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-bbca36bc-2b2a-4efa-92c2-3ffd6870c175 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.211819 May 26 13:57:42.852346 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 163/279] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:42 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:42.854701 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0056408a-69cf-4bee-a84f-b9a8012cc144 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.216053 May 26 13:57:42.855263 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 117/280] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:42 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:43.868579 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-750a47a3-1542-4888-83c4-72663ddc192f tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:43.869117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-750a47a3-1542-4888-83c4-72663ddc192f tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:43.871654 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e8db6cb5-e0b5-4788-93f3-44738a66d0d7 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:43.872228 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e8db6cb5-e0b5-4788-93f3-44738a66d0d7 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:43.875271 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-750a47a3-1542-4888-83c4-72663ddc192f tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:43.875781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-750a47a3-1542-4888-83c4-72663ddc192f tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:43.876627 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-750a47a3-1542-4888-83c4-72663ddc192f tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:43.877048 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-750a47a3-1542-4888-83c4-72663ddc192f tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:43.878624 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e8db6cb5-e0b5-4788-93f3-44738a66d0d7 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:43.879074 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e8db6cb5-e0b5-4788-93f3-44738a66d0d7 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:43.879837 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e8db6cb5-e0b5-4788-93f3-44738a66d0d7 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:43.880284 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e8db6cb5-e0b5-4788-93f3-44738a66d0d7 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:44.069360 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-750a47a3-1542-4888-83c4-72663ddc192f tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:44.075294 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e8db6cb5-e0b5-4788-93f3-44738a66d0d7 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:44.079263 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-750a47a3-1542-4888-83c4-72663ddc192f tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.214581 May 26 13:57:44.079937 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 164/281] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:43 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:44.083531 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e8db6cb5-e0b5-4788-93f3-44738a66d0d7 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1322 microversion: 2.1 time: 0.215698 May 26 13:57:44.084464 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 118/282] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:43 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:45.095950 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-eb7cec60-de43-4675-9dfd-3fa19db3dac3 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:45.097296 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-eb7cec60-de43-4675-9dfd-3fa19db3dac3 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:45.099511 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5aec444e-22d0-4cfe-acc4-d21b56bc4bed tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:45.100126 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5aec444e-22d0-4cfe-acc4-d21b56bc4bed tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:45.103662 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb7cec60-de43-4675-9dfd-3fa19db3dac3 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:45.104111 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb7cec60-de43-4675-9dfd-3fa19db3dac3 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:45.105054 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb7cec60-de43-4675-9dfd-3fa19db3dac3 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:45.105674 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb7cec60-de43-4675-9dfd-3fa19db3dac3 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:45.106819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5aec444e-22d0-4cfe-acc4-d21b56bc4bed tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:45.107304 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5aec444e-22d0-4cfe-acc4-d21b56bc4bed tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:45.108120 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5aec444e-22d0-4cfe-acc4-d21b56bc4bed tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:45.108565 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5aec444e-22d0-4cfe-acc4-d21b56bc4bed tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:45.309409 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-eb7cec60-de43-4675-9dfd-3fa19db3dac3 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:45.316016 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5aec444e-22d0-4cfe-acc4-d21b56bc4bed tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:45.318535 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-eb7cec60-de43-4675-9dfd-3fa19db3dac3 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.226524 May 26 13:57:45.319134 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 165/283] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:45 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:45.328091 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5aec444e-22d0-4cfe-acc4-d21b56bc4bed tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1515 microversion: 2.1 time: 0.231999 May 26 13:57:45.329023 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 119/284] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:45 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1515 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:45.346261 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3b5c873c-f3b8-4737-a355-6cab9e434333 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:57:45.347223 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3b5c873c-f3b8-4737-a355-6cab9e434333 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:45.353410 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3b5c873c-f3b8-4737-a355-6cab9e434333 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:45.353860 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3b5c873c-f3b8-4737-a355-6cab9e434333 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:45.354615 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3b5c873c-f3b8-4737-a355-6cab9e434333 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:45.355045 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3b5c873c-f3b8-4737-a355-6cab9e434333 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:45.377445 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-3b5c873c-f3b8-4737-a355-6cab9e434333 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lazy-loading 'flavor' on Instance uuid e953c9eb-adb5-49a2-b9c2-03633d118240 {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:57:45.494796 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3b5c873c-f3b8-4737-a355-6cab9e434333 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "POST /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240/action" status: 200 len: 32 microversion: 2.1 time: 0.152457 May 26 13:57:45.495427 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 166/285] 10.222.0.91 () {60 vars in 1277 bytes} [Thu May 26 13:57:45 2022] POST /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240/action => generated 32 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 13:57:45.511748 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dd931250-5733-4486-9be1-8f2ad3daa06e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:45.512448 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-dd931250-5733-4486-9be1-8f2ad3daa06e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:45.519505 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dd931250-5733-4486-9be1-8f2ad3daa06e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:45.519947 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dd931250-5733-4486-9be1-8f2ad3daa06e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:45.520705 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dd931250-5733-4486-9be1-8f2ad3daa06e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:45.521134 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dd931250-5733-4486-9be1-8f2ad3daa06e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:45.700146 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dd931250-5733-4486-9be1-8f2ad3daa06e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:45.711134 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dd931250-5733-4486-9be1-8f2ad3daa06e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.209933 May 26 13:57:45.711753 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 120/286] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:45 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:46.336261 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ef1d0d1c-b5d9-4660-866c-1c1aa51c65d5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:46.336962 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ef1d0d1c-b5d9-4660-866c-1c1aa51c65d5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:46.343397 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ef1d0d1c-b5d9-4660-866c-1c1aa51c65d5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:46.343847 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ef1d0d1c-b5d9-4660-866c-1c1aa51c65d5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:46.344618 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ef1d0d1c-b5d9-4660-866c-1c1aa51c65d5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:46.345058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ef1d0d1c-b5d9-4660-866c-1c1aa51c65d5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:46.485844 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ef1d0d1c-b5d9-4660-866c-1c1aa51c65d5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:46.493452 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ef1d0d1c-b5d9-4660-866c-1c1aa51c65d5 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.161481 May 26 13:57:46.494031 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 167/287] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:46 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:46.729495 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-932cd112-ec07-4dd7-9b69-6963e52b494e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:46.730209 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-932cd112-ec07-4dd7-9b69-6963e52b494e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:46.737844 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-932cd112-ec07-4dd7-9b69-6963e52b494e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:46.738298 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-932cd112-ec07-4dd7-9b69-6963e52b494e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:46.739062 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-932cd112-ec07-4dd7-9b69-6963e52b494e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:46.739498 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-932cd112-ec07-4dd7-9b69-6963e52b494e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:46.744414 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:46.896586 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-932cd112-ec07-4dd7-9b69-6963e52b494e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:46.905654 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-932cd112-ec07-4dd7-9b69-6963e52b494e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.181238 May 26 13:57:46.906404 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 121/288] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:46 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:47.510439 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d3d032bb-0fbe-4847-9b1d-310d63d8a814 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:47.511047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d3d032bb-0fbe-4847-9b1d-310d63d8a814 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:47.518260 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d3d032bb-0fbe-4847-9b1d-310d63d8a814 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:47.518714 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d3d032bb-0fbe-4847-9b1d-310d63d8a814 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:47.519479 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d3d032bb-0fbe-4847-9b1d-310d63d8a814 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:47.519910 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d3d032bb-0fbe-4847-9b1d-310d63d8a814 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:47.579260 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-8939d0ab-f3b5-47e6-bdd9-7211203167da req-031a3420-abef-420b-acb1-814ff6224965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deead541-6f7c-4096-819b-0a8fe84acd53", "name": "network-vif-plugged", "status": "completed", "tag": "8b18d3a7-cd65-4ce0-bf45-5db8540263cd"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:57:47.591894 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-8939d0ab-f3b5-47e6-bdd9-7211203167da req-031a3420-abef-420b-acb1-814ff6224965 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:47.592439 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-8939d0ab-f3b5-47e6-bdd9-7211203167da req-031a3420-abef-420b-acb1-814ff6224965 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:47.606963 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-8939d0ab-f3b5-47e6-bdd9-7211203167da req-031a3420-abef-420b-acb1-814ff6224965 service nova] Creating event network-vif-plugged:8b18d3a7-cd65-4ce0-bf45-5db8540263cd for instance deead541-6f7c-4096-819b-0a8fe84acd53 on hv-cinder-84213 May 26 13:57:47.613774 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-8939d0ab-f3b5-47e6-bdd9-7211203167da req-031a3420-abef-420b-acb1-814ff6224965 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038571 May 26 13:57:47.614594 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 122/289] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 13:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:57:47.664354 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d3d032bb-0fbe-4847-9b1d-310d63d8a814 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:47.672773 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d3d032bb-0fbe-4847-9b1d-310d63d8a814 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.166077 May 26 13:57:47.673411 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 168/290] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:47 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:47.923551 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-be8dda32-9c6f-4ecd-b45b-e181c9da4be0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:47.924312 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-be8dda32-9c6f-4ecd-b45b-e181c9da4be0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:47.931259 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-be8dda32-9c6f-4ecd-b45b-e181c9da4be0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:47.931473 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-be8dda32-9c6f-4ecd-b45b-e181c9da4be0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:47.932293 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-be8dda32-9c6f-4ecd-b45b-e181c9da4be0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:47.933078 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-be8dda32-9c6f-4ecd-b45b-e181c9da4be0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:48.069852 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-be8dda32-9c6f-4ecd-b45b-e181c9da4be0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:48.078798 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-be8dda32-9c6f-4ecd-b45b-e181c9da4be0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.159765 May 26 13:57:48.079546 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 123/291] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:47 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:48.690730 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-28b4dfe8-b4d0-4e7d-a355-0f7c2fb401a0 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:48.691456 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-28b4dfe8-b4d0-4e7d-a355-0f7c2fb401a0 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:48.697854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28b4dfe8-b4d0-4e7d-a355-0f7c2fb401a0 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:48.698373 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28b4dfe8-b4d0-4e7d-a355-0f7c2fb401a0 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:48.699393 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28b4dfe8-b4d0-4e7d-a355-0f7c2fb401a0 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:48.699825 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28b4dfe8-b4d0-4e7d-a355-0f7c2fb401a0 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:48.825500 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-28b4dfe8-b4d0-4e7d-a355-0f7c2fb401a0 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:48.829086 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:48.834101 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-28b4dfe8-b4d0-4e7d-a355-0f7c2fb401a0 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.147681 May 26 13:57:48.834672 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 169/292] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:48 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:49.095960 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9331f3d4-e237-4f7a-ac66-076531daab63 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:49.096599 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9331f3d4-e237-4f7a-ac66-076531daab63 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:49.103172 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9331f3d4-e237-4f7a-ac66-076531daab63 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:49.103617 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9331f3d4-e237-4f7a-ac66-076531daab63 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:49.104376 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9331f3d4-e237-4f7a-ac66-076531daab63 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:49.104810 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9331f3d4-e237-4f7a-ac66-076531daab63 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:49.255803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9331f3d4-e237-4f7a-ac66-076531daab63 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:49.265561 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9331f3d4-e237-4f7a-ac66-076531daab63 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.173248 May 26 13:57:49.266214 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 124/293] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:49 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:49.851763 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b1e8321d-43eb-49d5-979d-7f79c84ad7f0 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:49.852493 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b1e8321d-43eb-49d5-979d-7f79c84ad7f0 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:49.860507 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=90 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:49.864781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b1e8321d-43eb-49d5-979d-7f79c84ad7f0 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:49.865483 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b1e8321d-43eb-49d5-979d-7f79c84ad7f0 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:49.866981 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b1e8321d-43eb-49d5-979d-7f79c84ad7f0 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:49.867577 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b1e8321d-43eb-49d5-979d-7f79c84ad7f0 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:50.072148 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b1e8321d-43eb-49d5-979d-7f79c84ad7f0 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:50.081556 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b1e8321d-43eb-49d5-979d-7f79c84ad7f0 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.234536 May 26 13:57:50.082767 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 170/294] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:49 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:50.147977 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-606ef707-1ce8-42d2-9986-3bcb4d153d4c tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:50.149406 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-606ef707-1ce8-42d2-9986-3bcb4d153d4c tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:50.158671 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-606ef707-1ce8-42d2-9986-3bcb4d153d4c tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:50.159122 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-606ef707-1ce8-42d2-9986-3bcb4d153d4c tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:50.160389 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-606ef707-1ce8-42d2-9986-3bcb4d153d4c tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:50.161032 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-606ef707-1ce8-42d2-9986-3bcb4d153d4c tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:50.217599 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-606ef707-1ce8-42d2-9986-3bcb4d153d4c tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:57:50.284225 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f586ab22-16d6-4811-bf40-f4a5e4c6be8e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:50.293666 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f586ab22-16d6-4811-bf40-f4a5e4c6be8e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:50.300986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f586ab22-16d6-4811-bf40-f4a5e4c6be8e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:50.305592 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f586ab22-16d6-4811-bf40-f4a5e4c6be8e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:50.306500 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f586ab22-16d6-4811-bf40-f4a5e4c6be8e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:50.308946 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f586ab22-16d6-4811-bf40-f4a5e4c6be8e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:50.332769 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-606ef707-1ce8-42d2-9986-3bcb4d153d4c tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "DELETE /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 204 len: 0 microversion: 2.1 time: 0.189631 May 26 13:57:50.334058 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 125/295] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 13:57:50 2022] DELETE /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 13:57:50.351131 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3cf1e39e-e543-463a-b16b-fd39b828c02c tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:50.353340 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3cf1e39e-e543-463a-b16b-fd39b828c02c tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:50.363750 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3cf1e39e-e543-463a-b16b-fd39b828c02c tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:50.364214 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3cf1e39e-e543-463a-b16b-fd39b828c02c tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:50.364990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3cf1e39e-e543-463a-b16b-fd39b828c02c tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:50.366124 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3cf1e39e-e543-463a-b16b-fd39b828c02c tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:50.541969 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f586ab22-16d6-4811-bf40-f4a5e4c6be8e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:50.555923 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f586ab22-16d6-4811-bf40-f4a5e4c6be8e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.275988 May 26 13:57:50.565958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 171/296] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:50 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:50.577797 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3cf1e39e-e543-463a-b16b-fd39b828c02c tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:50.586116 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3cf1e39e-e543-463a-b16b-fd39b828c02c tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1553 microversion: 2.1 time: 0.247458 May 26 13:57:50.586690 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 126/297] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:50 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1553 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:51.100892 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4a80dba9-9bda-4468-97eb-f9a29e09b869 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:51.102137 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4a80dba9-9bda-4468-97eb-f9a29e09b869 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:51.109832 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4a80dba9-9bda-4468-97eb-f9a29e09b869 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:51.110278 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4a80dba9-9bda-4468-97eb-f9a29e09b869 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:51.111040 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4a80dba9-9bda-4468-97eb-f9a29e09b869 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:51.111464 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4a80dba9-9bda-4468-97eb-f9a29e09b869 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:51.247626 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4a80dba9-9bda-4468-97eb-f9a29e09b869 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:51.265933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4a80dba9-9bda-4468-97eb-f9a29e09b869 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.170381 May 26 13:57:51.266521 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 172/298] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:51 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:51.573508 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-773e9426-3cd4-43b0-88a4-521596198597 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:51.574137 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-773e9426-3cd4-43b0-88a4-521596198597 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:51.581186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-773e9426-3cd4-43b0-88a4-521596198597 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:51.581665 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-773e9426-3cd4-43b0-88a4-521596198597 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:51.582448 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-773e9426-3cd4-43b0-88a4-521596198597 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:51.582877 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-773e9426-3cd4-43b0-88a4-521596198597 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:51.604219 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b4317eaf-51a2-4e13-8430-6e7a950a2226 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:51.605078 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b4317eaf-51a2-4e13-8430-6e7a950a2226 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:51.611438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b4317eaf-51a2-4e13-8430-6e7a950a2226 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:51.611886 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b4317eaf-51a2-4e13-8430-6e7a950a2226 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:51.612649 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b4317eaf-51a2-4e13-8430-6e7a950a2226 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:51.613368 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b4317eaf-51a2-4e13-8430-6e7a950a2226 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:51.791782 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-773e9426-3cd4-43b0-88a4-521596198597 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:51.798026 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b4317eaf-51a2-4e13-8430-6e7a950a2226 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:51.803473 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-773e9426-3cd4-43b0-88a4-521596198597 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.233780 May 26 13:57:51.804046 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 127/299] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:51 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:51.814034 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b4317eaf-51a2-4e13-8430-6e7a950a2226 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1553 microversion: 2.1 time: 0.211280 May 26 13:57:51.814034 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 173/300] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:51 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1553 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:52.283333 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6a861be9-8a69-4554-b41d-f6615b5aa9fd tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:52.284132 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6a861be9-8a69-4554-b41d-f6615b5aa9fd tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:52.290937 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6a861be9-8a69-4554-b41d-f6615b5aa9fd tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:52.291383 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6a861be9-8a69-4554-b41d-f6615b5aa9fd tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:52.292477 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6a861be9-8a69-4554-b41d-f6615b5aa9fd tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:52.293117 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6a861be9-8a69-4554-b41d-f6615b5aa9fd tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:52.433960 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6a861be9-8a69-4554-b41d-f6615b5aa9fd tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:52.443212 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6a861be9-8a69-4554-b41d-f6615b5aa9fd tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1314 microversion: 2.1 time: 0.164212 May 26 13:57:52.449592 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 128/301] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:52 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:52.821489 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-91c8f7c1-4a1c-4a6d-a78d-f4a1d04be359 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:52.822619 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-91c8f7c1-4a1c-4a6d-a78d-f4a1d04be359 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:52.828841 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2c72e678-2098-43ac-a571-89da13eda8b0 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:52.829636 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2c72e678-2098-43ac-a571-89da13eda8b0 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:52.829760 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-91c8f7c1-4a1c-4a6d-a78d-f4a1d04be359 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:52.830224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-91c8f7c1-4a1c-4a6d-a78d-f4a1d04be359 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:52.830956 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-91c8f7c1-4a1c-4a6d-a78d-f4a1d04be359 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:52.831560 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-91c8f7c1-4a1c-4a6d-a78d-f4a1d04be359 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:52.836426 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2c72e678-2098-43ac-a571-89da13eda8b0 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:52.836873 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2c72e678-2098-43ac-a571-89da13eda8b0 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:52.837889 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2c72e678-2098-43ac-a571-89da13eda8b0 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:52.838616 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2c72e678-2098-43ac-a571-89da13eda8b0 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:53.024974 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-91c8f7c1-4a1c-4a6d-a78d-f4a1d04be359 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:53.035244 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-91c8f7c1-4a1c-4a6d-a78d-f4a1d04be359 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.217604 May 26 13:57:53.045026 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2c72e678-2098-43ac-a571-89da13eda8b0 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:53.045688 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 174/302] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:52 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:53.048220 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2c72e678-2098-43ac-a571-89da13eda8b0 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1553 microversion: 2.1 time: 0.223393 May 26 13:57:53.048858 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 129/303] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:52 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1553 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:53.459902 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-64671836-d947-4a75-9c65-a7b12bdefa47 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:53.460631 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-64671836-d947-4a75-9c65-a7b12bdefa47 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:53.467666 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-64671836-d947-4a75-9c65-a7b12bdefa47 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:53.468115 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-64671836-d947-4a75-9c65-a7b12bdefa47 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:53.468880 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-64671836-d947-4a75-9c65-a7b12bdefa47 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:53.469345 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-64671836-d947-4a75-9c65-a7b12bdefa47 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:53.659116 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-64671836-d947-4a75-9c65-a7b12bdefa47 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:53.667138 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-64671836-d947-4a75-9c65-a7b12bdefa47 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1464 microversion: 2.1 time: 0.211150 May 26 13:57:53.667713 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 175/304] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:53 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1464 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:53.708796 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ad0a9be7-d1d1-449b-91bc-799a20827bd3 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:53.709348 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ad0a9be7-d1d1-449b-91bc-799a20827bd3 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:53.716387 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ad0a9be7-d1d1-449b-91bc-799a20827bd3 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:53.717033 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ad0a9be7-d1d1-449b-91bc-799a20827bd3 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:53.717863 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ad0a9be7-d1d1-449b-91bc-799a20827bd3 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:53.718354 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ad0a9be7-d1d1-449b-91bc-799a20827bd3 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:53.750189 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ad0a9be7-d1d1-449b-91bc-799a20827bd3 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:57:53.844547 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ad0a9be7-d1d1-449b-91bc-799a20827bd3 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "DELETE /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 204 len: 0 microversion: 2.1 time: 0.139407 May 26 13:57:53.846925 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 130/305] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 13:57:53 2022] DELETE /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 13:57:53.854874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e363f732-8e35-47d5-b4a4-11402e694a42 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:53.855483 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e363f732-8e35-47d5-b4a4-11402e694a42 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:53.861912 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e363f732-8e35-47d5-b4a4-11402e694a42 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:53.862584 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e363f732-8e35-47d5-b4a4-11402e694a42 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:53.863127 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e363f732-8e35-47d5-b4a4-11402e694a42 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:53.863858 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e363f732-8e35-47d5-b4a4-11402e694a42 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:54.020877 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e363f732-8e35-47d5-b4a4-11402e694a42 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:54.035394 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e363f732-8e35-47d5-b4a4-11402e694a42 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1470 microversion: 2.1 time: 0.184195 May 26 13:57:54.035970 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 176/306] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:53 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1470 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:54.052462 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-601e5ef5-e0c5-4760-a38b-90e6e5e90ce4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:54.053258 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-601e5ef5-e0c5-4760-a38b-90e6e5e90ce4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:54.055250 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:54.062249 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-601e5ef5-e0c5-4760-a38b-90e6e5e90ce4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:54.063016 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-601e5ef5-e0c5-4760-a38b-90e6e5e90ce4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:54.064243 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-601e5ef5-e0c5-4760-a38b-90e6e5e90ce4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:54.064848 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-601e5ef5-e0c5-4760-a38b-90e6e5e90ce4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:54.066101 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c43eea02-433a-4d3b-813d-01b1d7da6aaf tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:54.066672 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c43eea02-433a-4d3b-813d-01b1d7da6aaf tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:54.073382 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c43eea02-433a-4d3b-813d-01b1d7da6aaf tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:54.074111 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c43eea02-433a-4d3b-813d-01b1d7da6aaf tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:54.075600 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c43eea02-433a-4d3b-813d-01b1d7da6aaf tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:54.076236 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c43eea02-433a-4d3b-813d-01b1d7da6aaf tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:54.284896 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c43eea02-433a-4d3b-813d-01b1d7da6aaf tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:54.297931 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-601e5ef5-e0c5-4760-a38b-90e6e5e90ce4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:54.310266 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c43eea02-433a-4d3b-813d-01b1d7da6aaf tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1553 microversion: 2.1 time: 0.248189 May 26 13:57:54.310994 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-601e5ef5-e0c5-4760-a38b-90e6e5e90ce4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.261773 May 26 13:57:54.320624 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 131/307] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:54 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:54.320792 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 177/308] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:54 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1553 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:55.051742 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-be80d08d-d653-43dc-b07f-842576ceaeb7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:55.052349 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-be80d08d-d653-43dc-b07f-842576ceaeb7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:55.058665 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-be80d08d-d653-43dc-b07f-842576ceaeb7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:55.059140 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-be80d08d-d653-43dc-b07f-842576ceaeb7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:55.059909 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-be80d08d-d653-43dc-b07f-842576ceaeb7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:55.060336 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-be80d08d-d653-43dc-b07f-842576ceaeb7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:55.198601 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-be80d08d-d653-43dc-b07f-842576ceaeb7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:55.207885 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-be80d08d-d653-43dc-b07f-842576ceaeb7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1470 microversion: 2.1 time: 0.159803 May 26 13:57:55.208494 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 132/309] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:55 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:55.330402 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4cfa2780-9a1e-47cc-814b-b057d415256a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:55.331093 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4cfa2780-9a1e-47cc-814b-b057d415256a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:55.332047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3eb46591-c42d-432e-97f6-d53723f5b7a1 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:55.333202 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3eb46591-c42d-432e-97f6-d53723f5b7a1 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:55.337758 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4cfa2780-9a1e-47cc-814b-b057d415256a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:55.338197 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4cfa2780-9a1e-47cc-814b-b057d415256a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:55.339077 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4cfa2780-9a1e-47cc-814b-b057d415256a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:55.339539 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4cfa2780-9a1e-47cc-814b-b057d415256a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:55.340075 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3eb46591-c42d-432e-97f6-d53723f5b7a1 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:55.341360 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3eb46591-c42d-432e-97f6-d53723f5b7a1 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:55.342257 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3eb46591-c42d-432e-97f6-d53723f5b7a1 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:55.343126 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3eb46591-c42d-432e-97f6-d53723f5b7a1 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:55.559902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4cfa2780-9a1e-47cc-814b-b057d415256a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:55.563893 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3eb46591-c42d-432e-97f6-d53723f5b7a1 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:55.568904 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4cfa2780-9a1e-47cc-814b-b057d415256a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.242799 May 26 13:57:55.570380 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 133/310] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:55 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:55.576572 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3eb46591-c42d-432e-97f6-d53723f5b7a1 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1553 microversion: 2.1 time: 0.251750 May 26 13:57:55.577144 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 178/311] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:55 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1553 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:56.227536 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-01b11190-b33c-4324-a910-f50cd92a2768 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:56.228139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-01b11190-b33c-4324-a910-f50cd92a2768 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:56.235208 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-01b11190-b33c-4324-a910-f50cd92a2768 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:56.235654 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-01b11190-b33c-4324-a910-f50cd92a2768 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:56.236402 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-01b11190-b33c-4324-a910-f50cd92a2768 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:56.237005 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-01b11190-b33c-4324-a910-f50cd92a2768 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:56.384483 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-01b11190-b33c-4324-a910-f50cd92a2768 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:56.392192 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-01b11190-b33c-4324-a910-f50cd92a2768 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1470 microversion: 2.1 time: 0.168350 May 26 13:57:56.392813 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 134/312] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:56 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:56.586157 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-bfa7bc50-1f03-49c2-9470-dbd40450a065 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:56.586937 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-bfa7bc50-1f03-49c2-9470-dbd40450a065 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:56.593530 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0a66ec6b-0b5d-4885-a7c8-27cac8b5f7ae tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:56.593694 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bfa7bc50-1f03-49c2-9470-dbd40450a065 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:56.594141 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bfa7bc50-1f03-49c2-9470-dbd40450a065 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:56.594256 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0a66ec6b-0b5d-4885-a7c8-27cac8b5f7ae tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:56.594914 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bfa7bc50-1f03-49c2-9470-dbd40450a065 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:56.595352 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bfa7bc50-1f03-49c2-9470-dbd40450a065 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:56.600611 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0a66ec6b-0b5d-4885-a7c8-27cac8b5f7ae tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:56.601281 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0a66ec6b-0b5d-4885-a7c8-27cac8b5f7ae tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:56.602197 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0a66ec6b-0b5d-4885-a7c8-27cac8b5f7ae tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:56.602816 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0a66ec6b-0b5d-4885-a7c8-27cac8b5f7ae tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:56.611189 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:57:56.833568 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bfa7bc50-1f03-49c2-9470-dbd40450a065 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:56.846683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-bfa7bc50-1f03-49c2-9470-dbd40450a065 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.264313 May 26 13:57:56.850233 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 179/313] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:56 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:56.878182 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0a66ec6b-0b5d-4885-a7c8-27cac8b5f7ae tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:56.886425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0a66ec6b-0b5d-4885-a7c8-27cac8b5f7ae tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1553 microversion: 2.1 time: 0.297291 May 26 13:57:56.886988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 135/314] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:56 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1553 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:57.411482 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fa39aff0-b384-4c50-96fe-84839b0a9e7e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:57.412440 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fa39aff0-b384-4c50-96fe-84839b0a9e7e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:57.422574 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fa39aff0-b384-4c50-96fe-84839b0a9e7e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:57.423294 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fa39aff0-b384-4c50-96fe-84839b0a9e7e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:57.424290 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fa39aff0-b384-4c50-96fe-84839b0a9e7e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:57.425040 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fa39aff0-b384-4c50-96fe-84839b0a9e7e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:57.814471 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fa39aff0-b384-4c50-96fe-84839b0a9e7e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:57.822428 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fa39aff0-b384-4c50-96fe-84839b0a9e7e tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1470 microversion: 2.1 time: 0.415916 May 26 13:57:57.823028 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 180/315] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:57 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1470 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:57.866965 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8fd64674-0a47-4ab4-b22e-6212b2ec6eb0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:57.867625 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8fd64674-0a47-4ab4-b22e-6212b2ec6eb0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:57.877304 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8fd64674-0a47-4ab4-b22e-6212b2ec6eb0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:57.877762 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8fd64674-0a47-4ab4-b22e-6212b2ec6eb0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:57.878537 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8fd64674-0a47-4ab4-b22e-6212b2ec6eb0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:57.879148 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8fd64674-0a47-4ab4-b22e-6212b2ec6eb0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:57.916400 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c5f33538-6d0b-4278-a802-4a8b16bad1e8 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:57.917014 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c5f33538-6d0b-4278-a802-4a8b16bad1e8 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:57.927572 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c5f33538-6d0b-4278-a802-4a8b16bad1e8 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:57.928935 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c5f33538-6d0b-4278-a802-4a8b16bad1e8 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:57.930108 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c5f33538-6d0b-4278-a802-4a8b16bad1e8 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:57.930713 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c5f33538-6d0b-4278-a802-4a8b16bad1e8 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:58.336564 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8fd64674-0a47-4ab4-b22e-6212b2ec6eb0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:58.347086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8fd64674-0a47-4ab4-b22e-6212b2ec6eb0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.482955 May 26 13:57:58.351344 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 136/316] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:57 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:58.353893 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c5f33538-6d0b-4278-a802-4a8b16bad1e8 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:58.362253 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-cc9456b2-b5f7-4eb2-8c5e-bd8daf074c26 req-1884d45e-b1c0-4b65-bdb9-c0e56df9bdc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deead541-6f7c-4096-819b-0a8fe84acd53", "name": "network-vif-deleted", "tag": "8b18d3a7-cd65-4ce0-bf45-5db8540263cd"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:57:58.363335 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c5f33538-6d0b-4278-a802-4a8b16bad1e8 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1553 microversion: 2.1 time: 0.461379 May 26 13:57:58.363921 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 181/317] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:57 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1553 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:58.383327 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-cc9456b2-b5f7-4eb2-8c5e-bd8daf074c26 req-1884d45e-b1c0-4b65-bdb9-c0e56df9bdc0 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:58.384377 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-cc9456b2-b5f7-4eb2-8c5e-bd8daf074c26 req-1884d45e-b1c0-4b65-bdb9-c0e56df9bdc0 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:58.399781 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-cc9456b2-b5f7-4eb2-8c5e-bd8daf074c26 req-1884d45e-b1c0-4b65-bdb9-c0e56df9bdc0 service nova] Creating event network-vif-deleted:8b18d3a7-cd65-4ce0-bf45-5db8540263cd for instance deead541-6f7c-4096-819b-0a8fe84acd53 on hv-cinder-84213 May 26 13:57:58.406538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-cc9456b2-b5f7-4eb2-8c5e-bd8daf074c26 req-1884d45e-b1c0-4b65-bdb9-c0e56df9bdc0 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051646 May 26 13:57:58.407440 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 137/318] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 13:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:57:58.839718 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-64b6d43e-8008-42b1-b1c3-d6a82f44b070 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:58.840356 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-64b6d43e-8008-42b1-b1c3-d6a82f44b070 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:58.846474 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-64b6d43e-8008-42b1-b1c3-d6a82f44b070 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:58.847020 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-64b6d43e-8008-42b1-b1c3-d6a82f44b070 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:58.847885 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-64b6d43e-8008-42b1-b1c3-d6a82f44b070 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:58.848317 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-64b6d43e-8008-42b1-b1c3-d6a82f44b070 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:58.882311 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-64b6d43e-8008-42b1-b1c3-d6a82f44b070 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:58.882587 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-64b6d43e-8008-42b1-b1c3-d6a82f44b070 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:58.883030 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-64b6d43e-8008-42b1-b1c3-d6a82f44b070 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lazy-loading 'fault' on Instance uuid deead541-6f7c-4096-819b-0a8fe84acd53 {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:57:58.931792 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-64b6d43e-8008-42b1-b1c3-d6a82f44b070 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90654dfe0c94d2ab61872dd244f4d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0926e6ea11a2454e9a5b4ef6c5fd2d96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:58.940235 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-64b6d43e-8008-42b1-b1c3-d6a82f44b070 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 200 len: 1304 microversion: 2.1 time: 0.104289 May 26 13:57:58.940805 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 182/319] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:58 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:59.368703 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-309a1ee3-9c0d-4626-a12d-20bf50bea400 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:59.369540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-309a1ee3-9c0d-4626-a12d-20bf50bea400 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:59.376966 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-309a1ee3-9c0d-4626-a12d-20bf50bea400 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:59.377670 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-309a1ee3-9c0d-4626-a12d-20bf50bea400 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:59.378487 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-309a1ee3-9c0d-4626-a12d-20bf50bea400 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:59.378976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-309a1ee3-9c0d-4626-a12d-20bf50bea400 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:59.380639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-30325e78-3089-4bf5-a312-12ac7887e6a4 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:59.381477 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-30325e78-3089-4bf5-a312-12ac7887e6a4 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:59.388080 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-30325e78-3089-4bf5-a312-12ac7887e6a4 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:59.388640 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-30325e78-3089-4bf5-a312-12ac7887e6a4 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:59.389548 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-30325e78-3089-4bf5-a312-12ac7887e6a4 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:59.390063 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-30325e78-3089-4bf5-a312-12ac7887e6a4 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:59.430808 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-30325e78-3089-4bf5-a312-12ac7887e6a4 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:59.431595 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-30325e78-3089-4bf5-a312-12ac7887e6a4 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:59.432232 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-30325e78-3089-4bf5-a312-12ac7887e6a4 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lazy-loading 'fault' on Instance uuid a8503557-47d9-4fc4-ad98-e698f675e2ce {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:57:59.486428 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-30325e78-3089-4bf5-a312-12ac7887e6a4 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda029aace2c4e40bcc470138243d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed49180e7f24cb296141d06576ead81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:59.494828 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-30325e78-3089-4bf5-a312-12ac7887e6a4 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 200 len: 1351 microversion: 2.1 time: 0.118850 May 26 13:57:59.495728 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 183/320] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:59 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 1351 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:57:59.553908 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-309a1ee3-9c0d-4626-a12d-20bf50bea400 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:57:59.567146 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-309a1ee3-9c0d-4626-a12d-20bf50bea400 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.202823 May 26 13:57:59.569191 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 138/321] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:59 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:57:59.956971 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1e12ef1c-ac4b-484c-a9e6-71bf28739cf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:57:59.957626 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1e12ef1c-ac4b-484c-a9e6-71bf28739cf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] [instance: deead541-6f7c-4096-819b-0a8fe84acd53] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:57:59.967609 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1e12ef1c-ac4b-484c-a9e6-71bf28739cf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:59.968059 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1e12ef1c-ac4b-484c-a9e6-71bf28739cf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:59.968827 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1e12ef1c-ac4b-484c-a9e6-71bf28739cf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:57:59.969297 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1e12ef1c-ac4b-484c-a9e6-71bf28739cf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:57:59.983190 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-1e12ef1c-ac4b-484c-a9e6-71bf28739cf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] HTTP exception thrown: Instance deead541-6f7c-4096-819b-0a8fe84acd53 could not be found. May 26 13:57:59.987960 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1e12ef1c-ac4b-484c-a9e6-71bf28739cf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Request method failure captured: May 26 13:57:59.987960 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 HTTP/1.1 May 26 13:57:59.987960 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 13:57:59.987960 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 13:57:59.987960 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 13:57:59.987960 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 13:57:59.987960 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 13:57:59.987960 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 13:57:59.987960 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 13:57:59.987960 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 13:57:59.987960 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4cWPXFx_CdVMN6WXSCzgir7WDudaLdAiKyxCKhDyRGhma7Cz9gUDQFeei0Ns-KOd1-lgGRmFK6MWkYLC2NlUOeMRwsFNW7q-g_FDlOdBksZORXobEMLAlvZ993QpjHee4HxyUSGj4eeQdfoxyDQhahwNw_L4Rcp63ZIRlUvFj9LqoA May 26 13:57:59.987960 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 13:57:59.987960 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 13:57:59.987960 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 13:57:59.987960 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 13:57:59.987960 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 13:57:59.987960 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 13:57:59.987960 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: 0926e6ea11a2454e9a5b4ef6c5fd2d96 May 26 13:57:59.987960 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-VolumesNegativeTest-1986588081 May 26 13:57:59.987960 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 13:57:59.987960 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 13:57:59.989463 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/0926e6ea11a2454e9a5b4ef6c5fd2d96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/0926e6ea11a2454e9a5b4ef6c5fd2d96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/0926e6ea11a2454e9a5b4ef6c5fd2d96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_0926e6ea11a2454e9a5b4ef6c5fd2d96", "adminURL": "http://10.222.0.91:8080"}]}] May 26 13:57:59.989463 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-VolumesNegativeTest-1986588081 May 26 13:57:59.989463 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 0926e6ea11a2454e9a5b4ef6c5fd2d96 May 26 13:57:59.989463 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-VolumesNegativeTest-1986588081 May 26 13:57:59.989463 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-VolumesNegativeTest-1986588081-project May 26 13:57:59.989463 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 13:57:59.989463 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 13:57:59.989463 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: f90654dfe0c94d2ab61872dd244f4d81 May 26 13:57:59.989463 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-VolumesNegativeTest-1986588081-project May 26 13:57:59.989463 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 13:57:59.989463 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Instance deead541-6f7c-4096-819b-0a8fe84acd53 could not be found. May 26 13:57:59.989463 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': 'deead541-6f7c-4096-819b-0a8fe84acd53'} May 26 13:57:59.990402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:57:59.990402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:57:59.990402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:57:59.990402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:57:59.990402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:57:59.990402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:57:59.990402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:57:59.990402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:57:59.990402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:57:59.990402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:57:59.990402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deead541-6f7c-4096-819b-0a8fe84acd53 could not be found. May 26 13:57:59.990402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:57:59.990402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:57:59.990402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:57:59.990402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:57:59.990402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:57:59.990402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:57:59.990402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:57:59.990402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:57:59.990402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:57:59.991601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:57:59.991601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:57:59.991601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:57:59.991601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:57:59.991601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:57:59.991601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:57:59.991601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:57:59.991601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deead541-6f7c-4096-819b-0a8fe84acd53 could not be found. May 26 13:57:59.991601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:57:59.991601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:57:59.991601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:57:59.991601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:57:59.991601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:57:59.991601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:57:59.991601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:57:59.991601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:57:59.991601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deead541-6f7c-4096-819b-0a8fe84acd53 could not be found. May 26 13:57:59.991601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:57:59.992770 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1e12ef1c-ac4b-484c-a9e6-71bf28739cf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] Returning 404 to user: Instance deead541-6f7c-4096-819b-0a8fe84acd53 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:57:59.992770 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1e12ef1c-ac4b-484c-a9e6-71bf28739cf7 tempest-VolumesNegativeTest-1986588081 tempest-VolumesNegativeTest-1986588081-project] 10.222.0.91 "GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53" status: 404 len: 111 microversion: 2.1 time: 0.036354 May 26 13:57:59.992770 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 184/322] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:57:59 2022] GET /compute/v2.1/servers/deead541-6f7c-4096-819b-0a8fe84acd53 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 13:58:00.422133 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-e5a0f1c1-d8cc-4c10-8374-efe14cfa7caa req-eb4d811a-aa04-4872-9815-371c29be8d05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8503557-47d9-4fc4-ad98-e698f675e2ce", "name": "network-vif-deleted", "tag": "f8d0143b-9f68-4c1b-a919-a3a667b7d168"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:58:00.430822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-e5a0f1c1-d8cc-4c10-8374-efe14cfa7caa req-eb4d811a-aa04-4872-9815-371c29be8d05 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:00.431269 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-e5a0f1c1-d8cc-4c10-8374-efe14cfa7caa req-eb4d811a-aa04-4872-9815-371c29be8d05 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:00.442922 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-e5a0f1c1-d8cc-4c10-8374-efe14cfa7caa req-eb4d811a-aa04-4872-9815-371c29be8d05 service nova] Creating event network-vif-deleted:f8d0143b-9f68-4c1b-a919-a3a667b7d168 for instance a8503557-47d9-4fc4-ad98-e698f675e2ce on hv-cinder-84213 May 26 13:58:00.448062 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-e5a0f1c1-d8cc-4c10-8374-efe14cfa7caa req-eb4d811a-aa04-4872-9815-371c29be8d05 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029557 May 26 13:58:00.448653 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 139/323] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 13:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:58:00.514123 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ac577294-558f-4517-8883-3c9ab90efa8b tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:00.514738 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ac577294-558f-4517-8883-3c9ab90efa8b tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:00.521226 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac577294-558f-4517-8883-3c9ab90efa8b tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:00.521612 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac577294-558f-4517-8883-3c9ab90efa8b tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:00.522410 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac577294-558f-4517-8883-3c9ab90efa8b tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:00.522840 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac577294-558f-4517-8883-3c9ab90efa8b tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:00.536537 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-ac577294-558f-4517-8883-3c9ab90efa8b tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] HTTP exception thrown: Instance a8503557-47d9-4fc4-ad98-e698f675e2ce could not be found. May 26 13:58:00.538087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ac577294-558f-4517-8883-3c9ab90efa8b tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Request method failure captured: May 26 13:58:00.538087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce HTTP/1.1 May 26 13:58:00.538087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 13:58:00.538087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 13:58:00.538087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 13:58:00.538087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 13:58:00.538087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 13:58:00.538087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 13:58:00.538087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 13:58:00.538087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 13:58:00.538087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4b0Y8Kl5mCeu2ti2aOdNHHE33Z2PJqlivqbN9J_7gkelANk_7RhZAxVXEEbeOpmiJZKxXGNMveegcjnJgfwz2_gAx9vtjlBYT6iAI5vsXOCXTzwFvfzFRjL7vicpsAH9geIKwR6WwmaQQx1JEsOTvBS2UoroVqFgfu-nsF73AyHWno May 26 13:58:00.538087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 13:58:00.538087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 13:58:00.538087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 13:58:00.538087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 13:58:00.538087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 13:58:00.538087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 13:58:00.538087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: 9ed49180e7f24cb296141d06576ead81 May 26 13:58:00.538087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-DeleteServersTestJSON-788665898 May 26 13:58:00.538087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 13:58:00.538087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 13:58:00.539562 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9ed49180e7f24cb296141d06576ead81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9ed49180e7f24cb296141d06576ead81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/9ed49180e7f24cb296141d06576ead81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_9ed49180e7f24cb296141d06576ead81", "adminURL": "http://10.222.0.91:8080"}]}] May 26 13:58:00.539562 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-DeleteServersTestJSON-788665898 May 26 13:58:00.539562 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 9ed49180e7f24cb296141d06576ead81 May 26 13:58:00.539562 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-DeleteServersTestJSON-788665898 May 26 13:58:00.539562 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-DeleteServersTestJSON-788665898-project May 26 13:58:00.539562 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 13:58:00.539562 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 13:58:00.539562 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: bda029aace2c4e40bcc470138243d0da May 26 13:58:00.539562 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-DeleteServersTestJSON-788665898-project May 26 13:58:00.539562 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 13:58:00.539562 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Instance a8503557-47d9-4fc4-ad98-e698f675e2ce could not be found. May 26 13:58:00.539562 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': 'a8503557-47d9-4fc4-ad98-e698f675e2ce'} May 26 13:58:00.540538 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:58:00.540538 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:58:00.540538 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:58:00.540538 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:58:00.540538 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:58:00.540538 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:58:00.540538 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:58:00.540538 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:58:00.540538 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:58:00.540538 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:58:00.540538 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8503557-47d9-4fc4-ad98-e698f675e2ce could not be found. May 26 13:58:00.540538 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:58:00.540538 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:58:00.540538 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:58:00.540538 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:58:00.540538 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:58:00.540538 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:58:00.540538 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:58:00.540538 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:58:00.540538 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:58:00.541881 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:58:00.541881 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:58:00.541881 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:58:00.541881 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:58:00.541881 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:58:00.541881 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:58:00.541881 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:58:00.541881 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8503557-47d9-4fc4-ad98-e698f675e2ce could not be found. May 26 13:58:00.541881 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:58:00.541881 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:58:00.541881 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:58:00.541881 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:58:00.541881 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:58:00.541881 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:58:00.541881 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:58:00.541881 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:58:00.541881 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8503557-47d9-4fc4-ad98-e698f675e2ce could not be found. May 26 13:58:00.541881 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:58:00.543160 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ac577294-558f-4517-8883-3c9ab90efa8b tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Returning 404 to user: Instance a8503557-47d9-4fc4-ad98-e698f675e2ce could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:58:00.543160 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ac577294-558f-4517-8883-3c9ab90efa8b tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 404 len: 111 microversion: 2.1 time: 0.031320 May 26 13:58:00.543160 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 185/324] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:00 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:58:00.587543 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e44ae627-08b2-423d-94d3-ece0564e5c28 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:00.588244 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e44ae627-08b2-423d-94d3-ece0564e5c28 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:00.594816 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e44ae627-08b2-423d-94d3-ece0564e5c28 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:00.595437 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e44ae627-08b2-423d-94d3-ece0564e5c28 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:00.596137 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e44ae627-08b2-423d-94d3-ece0564e5c28 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:00.596696 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e44ae627-08b2-423d-94d3-ece0564e5c28 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:00.645315 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f8fda4de-20ae-4a2f-a2b1-587c17ef0f90 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:00.646320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f8fda4de-20ae-4a2f-a2b1-587c17ef0f90 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:00.653067 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f8fda4de-20ae-4a2f-a2b1-587c17ef0f90 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:00.653553 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f8fda4de-20ae-4a2f-a2b1-587c17ef0f90 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:00.654316 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f8fda4de-20ae-4a2f-a2b1-587c17ef0f90 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:00.654750 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f8fda4de-20ae-4a2f-a2b1-587c17ef0f90 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:00.667462 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-f8fda4de-20ae-4a2f-a2b1-587c17ef0f90 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] HTTP exception thrown: Instance a8503557-47d9-4fc4-ad98-e698f675e2ce could not be found. May 26 13:58:00.669757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f8fda4de-20ae-4a2f-a2b1-587c17ef0f90 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Request method failure captured: May 26 13:58:00.669757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce/os-volume_attachments HTTP/1.1 May 26 13:58:00.669757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 13:58:00.669757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 13:58:00.669757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 13:58:00.669757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 13:58:00.669757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 13:58:00.669757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 13:58:00.669757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 13:58:00.669757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 13:58:00.669757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4b0Y8Kl5mCeu2ti2aOdNHHE33Z2PJqlivqbN9J_7gkelANk_7RhZAxVXEEbeOpmiJZKxXGNMveegcjnJgfwz2_gAx9vtjlBYT6iAI5vsXOCXTzwFvfzFRjL7vicpsAH9geIKwR6WwmaQQx1JEsOTvBS2UoroVqFgfu-nsF73AyHWno May 26 13:58:00.669757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 13:58:00.669757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 13:58:00.669757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 13:58:00.669757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 13:58:00.669757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 13:58:00.669757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 13:58:00.669757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: 9ed49180e7f24cb296141d06576ead81 May 26 13:58:00.669757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-DeleteServersTestJSON-788665898 May 26 13:58:00.669757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 13:58:00.669757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 13:58:00.671235 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9ed49180e7f24cb296141d06576ead81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9ed49180e7f24cb296141d06576ead81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/9ed49180e7f24cb296141d06576ead81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_9ed49180e7f24cb296141d06576ead81", "adminURL": "http://10.222.0.91:8080"}]}] May 26 13:58:00.671235 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-DeleteServersTestJSON-788665898 May 26 13:58:00.671235 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 9ed49180e7f24cb296141d06576ead81 May 26 13:58:00.671235 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-DeleteServersTestJSON-788665898 May 26 13:58:00.671235 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-DeleteServersTestJSON-788665898-project May 26 13:58:00.671235 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 13:58:00.671235 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 13:58:00.671235 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: bda029aace2c4e40bcc470138243d0da May 26 13:58:00.671235 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-DeleteServersTestJSON-788665898-project May 26 13:58:00.671235 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 13:58:00.671235 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Instance a8503557-47d9-4fc4-ad98-e698f675e2ce could not be found. May 26 13:58:00.671235 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'server_id': 'a8503557-47d9-4fc4-ad98-e698f675e2ce'} May 26 13:58:00.671947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:58:00.671947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:58:00.671947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:58:00.671947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:58:00.671947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:58:00.671947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:58:00.671947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:58:00.671947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:58:00.671947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:58:00.671947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:58:00.671947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8503557-47d9-4fc4-ad98-e698f675e2ce could not be found. May 26 13:58:00.671947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:58:00.671947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:58:00.671947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:58:00.671947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:58:00.671947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:58:00.671947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:58:00.671947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:58:00.671947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:58:00.671947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:58:00.673230 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:58:00.673230 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 13:58:00.673230 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 13:58:00.673230 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 13:58:00.673230 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 13:58:00.673230 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 26 13:58:00.673230 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 26 13:58:00.673230 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:58:00.673230 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:58:00.673230 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8503557-47d9-4fc4-ad98-e698f675e2ce could not be found. May 26 13:58:00.673230 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:58:00.673230 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:58:00.673230 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:58:00.673230 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:58:00.673230 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:58:00.673230 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:58:00.673230 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:58:00.673230 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:58:00.673230 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8503557-47d9-4fc4-ad98-e698f675e2ce could not be found. May 26 13:58:00.673230 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:58:00.674531 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f8fda4de-20ae-4a2f-a2b1-587c17ef0f90 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Returning 404 to user: Instance a8503557-47d9-4fc4-ad98-e698f675e2ce could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:58:00.674531 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f8fda4de-20ae-4a2f-a2b1-587c17ef0f90 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029849 May 26 13:58:00.674531 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 186/325] 10.222.0.91 () {58 vars in 1301 bytes} [Thu May 26 13:58:00 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:58:00.732454 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e44ae627-08b2-423d-94d3-ece0564e5c28 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:00.743368 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e44ae627-08b2-423d-94d3-ece0564e5c28 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.160165 May 26 13:58:00.743949 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 140/326] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:00 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:01.760507 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fa89763b-4697-46c4-b380-e115da9748f4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:01.762216 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fa89763b-4697-46c4-b380-e115da9748f4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:01.768527 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fa89763b-4697-46c4-b380-e115da9748f4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:01.769330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fa89763b-4697-46c4-b380-e115da9748f4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:01.770418 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fa89763b-4697-46c4-b380-e115da9748f4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:01.770848 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fa89763b-4697-46c4-b380-e115da9748f4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:01.926769 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fa89763b-4697-46c4-b380-e115da9748f4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:01.932721 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:01.935965 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fa89763b-4697-46c4-b380-e115da9748f4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.179327 May 26 13:58:01.936593 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 187/327] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:01 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:02.948971 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f2c15b2e-eea2-414a-adbd-0ea9757607d9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:02.949519 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f2c15b2e-eea2-414a-adbd-0ea9757607d9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:02.957098 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5ee43338-61d5-4b35-9282-d439b3dfb926 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:02.958086 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5ee43338-61d5-4b35-9282-d439b3dfb926 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:02.958364 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f2c15b2e-eea2-414a-adbd-0ea9757607d9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:02.959498 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f2c15b2e-eea2-414a-adbd-0ea9757607d9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:02.961375 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f2c15b2e-eea2-414a-adbd-0ea9757607d9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:02.961997 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f2c15b2e-eea2-414a-adbd-0ea9757607d9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:02.970660 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5ee43338-61d5-4b35-9282-d439b3dfb926 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:02.971859 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5ee43338-61d5-4b35-9282-d439b3dfb926 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:02.973466 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5ee43338-61d5-4b35-9282-d439b3dfb926 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:02.974441 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5ee43338-61d5-4b35-9282-d439b3dfb926 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:02.981066 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-f2c15b2e-eea2-414a-adbd-0ea9757607d9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] HTTP exception thrown: Instance a8503557-47d9-4fc4-ad98-e698f675e2ce could not be found. May 26 13:58:02.986057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f2c15b2e-eea2-414a-adbd-0ea9757607d9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Request method failure captured: May 26 13:58:02.986057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: DELETE /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce HTTP/1.1 May 26 13:58:02.986057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 13:58:02.986057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 13:58:02.986057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 13:58:02.986057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 13:58:02.986057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 13:58:02.986057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 13:58:02.986057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 13:58:02.986057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 13:58:02.986057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4b0Y8Kl5mCeu2ti2aOdNHHE33Z2PJqlivqbN9J_7gkelANk_7RhZAxVXEEbeOpmiJZKxXGNMveegcjnJgfwz2_gAx9vtjlBYT6iAI5vsXOCXTzwFvfzFRjL7vicpsAH9geIKwR6WwmaQQx1JEsOTvBS2UoroVqFgfu-nsF73AyHWno May 26 13:58:02.986057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 13:58:02.986057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 13:58:02.986057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 13:58:02.986057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 13:58:02.986057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 13:58:02.986057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 13:58:02.986057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: 9ed49180e7f24cb296141d06576ead81 May 26 13:58:02.986057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-DeleteServersTestJSON-788665898 May 26 13:58:02.986057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 13:58:02.986057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 13:58:02.988735 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9ed49180e7f24cb296141d06576ead81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9ed49180e7f24cb296141d06576ead81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/9ed49180e7f24cb296141d06576ead81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_9ed49180e7f24cb296141d06576ead81", "adminURL": "http://10.222.0.91:8080"}]}] May 26 13:58:02.988735 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-DeleteServersTestJSON-788665898 May 26 13:58:02.988735 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 9ed49180e7f24cb296141d06576ead81 May 26 13:58:02.988735 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-DeleteServersTestJSON-788665898 May 26 13:58:02.988735 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-DeleteServersTestJSON-788665898-project May 26 13:58:02.988735 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 13:58:02.988735 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 13:58:02.988735 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: bda029aace2c4e40bcc470138243d0da May 26 13:58:02.988735 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-DeleteServersTestJSON-788665898-project May 26 13:58:02.988735 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: > May 26 13:58:02.988735 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Instance a8503557-47d9-4fc4-ad98-e698f675e2ce could not be found. May 26 13:58:02.988735 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'id': 'a8503557-47d9-4fc4-ad98-e698f675e2ce'} May 26 13:58:02.990193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:58:02.990193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:58:02.990193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:58:02.990193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:58:02.990193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:58:02.990193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:58:02.990193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:58:02.990193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:58:02.990193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:58:02.990193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:58:02.990193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8503557-47d9-4fc4-ad98-e698f675e2ce could not be found. May 26 13:58:02.990193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:58:02.990193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:58:02.990193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:58:02.990193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:58:02.990193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:58:02.990193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:58:02.990193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:58:02.990193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:58:02.990193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:58:02.992552 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:58:02.992552 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 13:58:02.992552 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 13:58:02.992552 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 13:58:02.992552 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 13:58:02.992552 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:58:02.992552 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:58:02.992552 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:58:02.992552 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:58:02.992552 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8503557-47d9-4fc4-ad98-e698f675e2ce could not be found. May 26 13:58:02.992552 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:58:02.992552 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:58:02.992552 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:58:02.992552 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:58:02.992552 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:58:02.992552 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:58:02.992552 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:58:02.992552 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:58:02.992552 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8503557-47d9-4fc4-ad98-e698f675e2ce could not be found. May 26 13:58:02.992552 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:58:02.996628 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f2c15b2e-eea2-414a-adbd-0ea9757607d9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Returning 404 to user: Instance a8503557-47d9-4fc4-ad98-e698f675e2ce could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:58:02.996628 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f2c15b2e-eea2-414a-adbd-0ea9757607d9 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "DELETE /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 404 len: 111 microversion: 2.1 time: 0.042746 May 26 13:58:02.996628 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 141/328] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 13:58:02 2022] DELETE /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:58:02.996628 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-37e31fa7-c64e-46e3-9443-2b65d7cba221 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:02.996628 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-37e31fa7-c64e-46e3-9443-2b65d7cba221 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] [instance: a8503557-47d9-4fc4-ad98-e698f675e2ce] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:03.002514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37e31fa7-c64e-46e3-9443-2b65d7cba221 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:03.002967 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37e31fa7-c64e-46e3-9443-2b65d7cba221 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:03.003736 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37e31fa7-c64e-46e3-9443-2b65d7cba221 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:03.004178 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37e31fa7-c64e-46e3-9443-2b65d7cba221 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:03.018118 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-37e31fa7-c64e-46e3-9443-2b65d7cba221 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] HTTP exception thrown: Instance a8503557-47d9-4fc4-ad98-e698f675e2ce could not be found. May 26 13:58:03.019693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-37e31fa7-c64e-46e3-9443-2b65d7cba221 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Request method failure captured: May 26 13:58:03.019693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce HTTP/1.1 May 26 13:58:03.019693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 13:58:03.019693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 13:58:03.019693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 13:58:03.019693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 13:58:03.019693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 13:58:03.019693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 13:58:03.019693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 13:58:03.019693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 13:58:03.019693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4b0Y8Kl5mCeu2ti2aOdNHHE33Z2PJqlivqbN9J_7gkelANk_7RhZAxVXEEbeOpmiJZKxXGNMveegcjnJgfwz2_gAx9vtjlBYT6iAI5vsXOCXTzwFvfzFRjL7vicpsAH9geIKwR6WwmaQQx1JEsOTvBS2UoroVqFgfu-nsF73AyHWno May 26 13:58:03.019693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 13:58:03.019693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 13:58:03.019693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 13:58:03.019693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 13:58:03.019693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 13:58:03.019693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 13:58:03.019693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: 9ed49180e7f24cb296141d06576ead81 May 26 13:58:03.019693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-DeleteServersTestJSON-788665898 May 26 13:58:03.019693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 13:58:03.019693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 13:58:03.020894 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9ed49180e7f24cb296141d06576ead81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9ed49180e7f24cb296141d06576ead81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/9ed49180e7f24cb296141d06576ead81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_9ed49180e7f24cb296141d06576ead81", "adminURL": "http://10.222.0.91:8080"}]}] May 26 13:58:03.020894 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-DeleteServersTestJSON-788665898 May 26 13:58:03.020894 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 9ed49180e7f24cb296141d06576ead81 May 26 13:58:03.020894 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-DeleteServersTestJSON-788665898 May 26 13:58:03.020894 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-DeleteServersTestJSON-788665898-project May 26 13:58:03.020894 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 13:58:03.020894 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 13:58:03.020894 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: bda029aace2c4e40bcc470138243d0da May 26 13:58:03.020894 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-DeleteServersTestJSON-788665898-project May 26 13:58:03.020894 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: > May 26 13:58:03.020894 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Instance a8503557-47d9-4fc4-ad98-e698f675e2ce could not be found. May 26 13:58:03.020894 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'id': 'a8503557-47d9-4fc4-ad98-e698f675e2ce'} May 26 13:58:03.021657 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:58:03.021657 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:58:03.021657 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:58:03.021657 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:58:03.021657 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:58:03.021657 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:58:03.021657 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:58:03.021657 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:58:03.021657 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:58:03.021657 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:58:03.021657 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8503557-47d9-4fc4-ad98-e698f675e2ce could not be found. May 26 13:58:03.021657 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:58:03.021657 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:58:03.021657 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:58:03.021657 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:58:03.021657 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:58:03.021657 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:58:03.021657 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:58:03.021657 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:58:03.021657 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:58:03.022803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:58:03.022803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:58:03.022803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:58:03.022803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:58:03.022803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:58:03.022803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:58:03.022803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:58:03.022803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8503557-47d9-4fc4-ad98-e698f675e2ce could not be found. May 26 13:58:03.022803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:58:03.022803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:58:03.022803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:58:03.022803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:58:03.022803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:58:03.022803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:58:03.022803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:58:03.022803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:58:03.022803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8503557-47d9-4fc4-ad98-e698f675e2ce could not be found. May 26 13:58:03.022803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:58:03.023878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-37e31fa7-c64e-46e3-9443-2b65d7cba221 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] Returning 404 to user: Instance a8503557-47d9-4fc4-ad98-e698f675e2ce could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:58:03.023878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-37e31fa7-c64e-46e3-9443-2b65d7cba221 tempest-DeleteServersTestJSON-788665898 tempest-DeleteServersTestJSON-788665898-project] 10.222.0.91 "GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce" status: 404 len: 111 microversion: 2.1 time: 0.029016 May 26 13:58:03.025410 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 142/329] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:02 2022] GET /compute/v2.1/servers/a8503557-47d9-4fc4-ad98-e698f675e2ce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:58:03.228314 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5ee43338-61d5-4b35-9282-d439b3dfb926 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:03.235827 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5ee43338-61d5-4b35-9282-d439b3dfb926 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.286947 May 26 13:58:03.236398 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 188/330] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:02 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:58:04.253505 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5c1694ca-af75-42cd-a8c2-73f206631207 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:04.254314 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5c1694ca-af75-42cd-a8c2-73f206631207 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:04.261429 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5c1694ca-af75-42cd-a8c2-73f206631207 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:04.262026 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5c1694ca-af75-42cd-a8c2-73f206631207 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:04.262798 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5c1694ca-af75-42cd-a8c2-73f206631207 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:04.263242 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5c1694ca-af75-42cd-a8c2-73f206631207 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:04.405723 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5c1694ca-af75-42cd-a8c2-73f206631207 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:04.413418 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5c1694ca-af75-42cd-a8c2-73f206631207 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.163774 May 26 13:58:04.420413 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 143/331] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:04 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:05.429784 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8a1cfdbe-2ab6-400e-84a8-74c9cc56d649 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:05.430410 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8a1cfdbe-2ab6-400e-84a8-74c9cc56d649 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:05.436991 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8a1cfdbe-2ab6-400e-84a8-74c9cc56d649 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:05.437453 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8a1cfdbe-2ab6-400e-84a8-74c9cc56d649 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:05.438220 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8a1cfdbe-2ab6-400e-84a8-74c9cc56d649 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:05.438693 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8a1cfdbe-2ab6-400e-84a8-74c9cc56d649 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:05.591024 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8a1cfdbe-2ab6-400e-84a8-74c9cc56d649 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:05.598529 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8a1cfdbe-2ab6-400e-84a8-74c9cc56d649 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.172555 May 26 13:58:05.599092 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 189/332] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:05 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:06.615531 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3c19d613-c45c-404a-83ef-ace420518e46 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:06.616229 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3c19d613-c45c-404a-83ef-ace420518e46 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:06.627247 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c19d613-c45c-404a-83ef-ace420518e46 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:06.627698 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c19d613-c45c-404a-83ef-ace420518e46 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:06.628480 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c19d613-c45c-404a-83ef-ace420518e46 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:06.628920 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c19d613-c45c-404a-83ef-ace420518e46 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:06.765365 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3c19d613-c45c-404a-83ef-ace420518e46 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:06.773179 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3c19d613-c45c-404a-83ef-ace420518e46 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.161525 May 26 13:58:06.773753 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 144/333] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:06 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:07.791774 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-aa1b0582-aeb8-483d-86e1-82a3f724f832 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:07.792374 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-aa1b0582-aeb8-483d-86e1-82a3f724f832 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:07.798937 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aa1b0582-aeb8-483d-86e1-82a3f724f832 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:07.799631 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aa1b0582-aeb8-483d-86e1-82a3f724f832 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:07.800427 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aa1b0582-aeb8-483d-86e1-82a3f724f832 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:07.800852 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aa1b0582-aeb8-483d-86e1-82a3f724f832 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:07.930656 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-aa1b0582-aeb8-483d-86e1-82a3f724f832 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:07.938583 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-aa1b0582-aeb8-483d-86e1-82a3f724f832 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.150724 May 26 13:58:07.939147 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 190/334] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:07 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:08.955463 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3f8ba9cd-8087-4d87-bba3-a28d2d5c4e97 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:08.956070 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3f8ba9cd-8087-4d87-bba3-a28d2d5c4e97 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:08.963259 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f8ba9cd-8087-4d87-bba3-a28d2d5c4e97 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:08.963747 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f8ba9cd-8087-4d87-bba3-a28d2d5c4e97 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:08.964523 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f8ba9cd-8087-4d87-bba3-a28d2d5c4e97 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:08.964959 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f8ba9cd-8087-4d87-bba3-a28d2d5c4e97 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:09.131962 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3f8ba9cd-8087-4d87-bba3-a28d2d5c4e97 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:09.143231 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3f8ba9cd-8087-4d87-bba3-a28d2d5c4e97 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.191626 May 26 13:58:09.144664 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 145/335] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:08 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:10.160176 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8823f473-6892-4fdb-b54e-aa00328c7df5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:10.160785 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8823f473-6892-4fdb-b54e-aa00328c7df5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:10.166877 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8823f473-6892-4fdb-b54e-aa00328c7df5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:10.167325 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8823f473-6892-4fdb-b54e-aa00328c7df5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:10.168108 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8823f473-6892-4fdb-b54e-aa00328c7df5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:10.168511 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8823f473-6892-4fdb-b54e-aa00328c7df5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:10.300745 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8823f473-6892-4fdb-b54e-aa00328c7df5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:10.308254 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8823f473-6892-4fdb-b54e-aa00328c7df5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.151844 May 26 13:58:10.308806 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 191/336] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:10 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:11.325693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-60a0cdc7-da36-4afb-bcb1-2b662b483d8b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:11.327412 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-60a0cdc7-da36-4afb-bcb1-2b662b483d8b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:11.333798 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-60a0cdc7-da36-4afb-bcb1-2b662b483d8b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:11.334244 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-60a0cdc7-da36-4afb-bcb1-2b662b483d8b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:11.334992 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-60a0cdc7-da36-4afb-bcb1-2b662b483d8b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:11.335423 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-60a0cdc7-da36-4afb-bcb1-2b662b483d8b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:11.464372 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-60a0cdc7-da36-4afb-bcb1-2b662b483d8b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:11.471719 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-60a0cdc7-da36-4afb-bcb1-2b662b483d8b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.149775 May 26 13:58:11.472280 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 146/337] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:11 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:12.488243 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-865bafd3-70db-4972-85db-d2adc80396f8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:12.488871 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-865bafd3-70db-4972-85db-d2adc80396f8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:12.494983 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-865bafd3-70db-4972-85db-d2adc80396f8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:12.495428 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-865bafd3-70db-4972-85db-d2adc80396f8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:12.496176 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-865bafd3-70db-4972-85db-d2adc80396f8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:12.496608 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-865bafd3-70db-4972-85db-d2adc80396f8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:12.625025 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-865bafd3-70db-4972-85db-d2adc80396f8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:12.632374 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-865bafd3-70db-4972-85db-d2adc80396f8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.147976 May 26 13:58:12.632943 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 192/338] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:12 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:13.649577 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-74d6e668-492b-4a34-be0f-4d1b95dfa54e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:13.650108 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-74d6e668-492b-4a34-be0f-4d1b95dfa54e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:13.658082 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-74d6e668-492b-4a34-be0f-4d1b95dfa54e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:13.658538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-74d6e668-492b-4a34-be0f-4d1b95dfa54e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:13.659298 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-74d6e668-492b-4a34-be0f-4d1b95dfa54e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:13.659735 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-74d6e668-492b-4a34-be0f-4d1b95dfa54e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:13.792402 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-74d6e668-492b-4a34-be0f-4d1b95dfa54e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:13.800734 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-74d6e668-492b-4a34-be0f-4d1b95dfa54e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.154957 May 26 13:58:13.801335 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 147/339] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:13 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:14.818016 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8e5c1052-2cb9-4e0a-bf4a-694756aa23e7 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:14.818501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8e5c1052-2cb9-4e0a-bf4a-694756aa23e7 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:14.824611 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8e5c1052-2cb9-4e0a-bf4a-694756aa23e7 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:14.825056 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8e5c1052-2cb9-4e0a-bf4a-694756aa23e7 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:14.825927 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8e5c1052-2cb9-4e0a-bf4a-694756aa23e7 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:14.826447 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8e5c1052-2cb9-4e0a-bf4a-694756aa23e7 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:14.954094 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8e5c1052-2cb9-4e0a-bf4a-694756aa23e7 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:14.961836 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8e5c1052-2cb9-4e0a-bf4a-694756aa23e7 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.147796 May 26 13:58:14.962404 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 193/340] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:14 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:15.978624 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-deb031f0-47e1-4852-9715-12977f6311a4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:15.979229 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-deb031f0-47e1-4852-9715-12977f6311a4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:15.986581 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-deb031f0-47e1-4852-9715-12977f6311a4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:15.987024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-deb031f0-47e1-4852-9715-12977f6311a4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:15.987784 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-deb031f0-47e1-4852-9715-12977f6311a4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:15.988365 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-deb031f0-47e1-4852-9715-12977f6311a4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:16.114320 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-deb031f0-47e1-4852-9715-12977f6311a4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:16.122022 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-deb031f0-47e1-4852-9715-12977f6311a4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.147518 May 26 13:58:16.123079 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 148/341] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:15 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:58:17.139267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ff0e8ebb-ce01-4587-a15a-4f6f0d62d712 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:17.139862 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ff0e8ebb-ce01-4587-a15a-4f6f0d62d712 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:17.145813 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ff0e8ebb-ce01-4587-a15a-4f6f0d62d712 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:17.146258 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ff0e8ebb-ce01-4587-a15a-4f6f0d62d712 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:17.147000 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ff0e8ebb-ce01-4587-a15a-4f6f0d62d712 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:17.147426 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ff0e8ebb-ce01-4587-a15a-4f6f0d62d712 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:17.287113 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ff0e8ebb-ce01-4587-a15a-4f6f0d62d712 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:17.295258 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ff0e8ebb-ce01-4587-a15a-4f6f0d62d712 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.159353 May 26 13:58:17.295914 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 194/342] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:17 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:18.312692 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d73fbcae-ea8d-47be-afe9-b0960aaeea7f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:18.313384 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d73fbcae-ea8d-47be-afe9-b0960aaeea7f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:18.323157 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d73fbcae-ea8d-47be-afe9-b0960aaeea7f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:18.323614 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d73fbcae-ea8d-47be-afe9-b0960aaeea7f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:18.324424 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d73fbcae-ea8d-47be-afe9-b0960aaeea7f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:18.324863 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d73fbcae-ea8d-47be-afe9-b0960aaeea7f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:18.517755 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d73fbcae-ea8d-47be-afe9-b0960aaeea7f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:18.527855 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d73fbcae-ea8d-47be-afe9-b0960aaeea7f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.219519 May 26 13:58:18.528752 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 149/343] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:18 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:19.545614 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e08d93fb-84fe-4412-a14e-c774f8add9fe tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:19.546220 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e08d93fb-84fe-4412-a14e-c774f8add9fe tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:19.553398 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e08d93fb-84fe-4412-a14e-c774f8add9fe tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:19.553906 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e08d93fb-84fe-4412-a14e-c774f8add9fe tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:19.554693 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e08d93fb-84fe-4412-a14e-c774f8add9fe tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:19.555190 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e08d93fb-84fe-4412-a14e-c774f8add9fe tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:19.724348 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e08d93fb-84fe-4412-a14e-c774f8add9fe tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:19.733848 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e08d93fb-84fe-4412-a14e-c774f8add9fe tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.192320 May 26 13:58:19.734429 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 195/344] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:19 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:20.750075 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-328b6153-173f-4e3d-aa77-699d4ad6fcc8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:20.750896 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-328b6153-173f-4e3d-aa77-699d4ad6fcc8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:20.757336 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-328b6153-173f-4e3d-aa77-699d4ad6fcc8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:20.757893 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-328b6153-173f-4e3d-aa77-699d4ad6fcc8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:20.758617 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-328b6153-173f-4e3d-aa77-699d4ad6fcc8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:20.759053 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-328b6153-173f-4e3d-aa77-699d4ad6fcc8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:20.899453 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-328b6153-173f-4e3d-aa77-699d4ad6fcc8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:20.908227 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-328b6153-173f-4e3d-aa77-699d4ad6fcc8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.161809 May 26 13:58:20.909230 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 150/345] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:20 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:21.934191 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f95df791-5c15-4f81-a18c-4550983f6a61 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:21.934191 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f95df791-5c15-4f81-a18c-4550983f6a61 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:21.934191 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=56 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:21.934191 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f95df791-5c15-4f81-a18c-4550983f6a61 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:21.935418 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f95df791-5c15-4f81-a18c-4550983f6a61 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:21.936655 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f95df791-5c15-4f81-a18c-4550983f6a61 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:21.937093 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f95df791-5c15-4f81-a18c-4550983f6a61 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:22.080751 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f95df791-5c15-4f81-a18c-4550983f6a61 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:22.088779 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f95df791-5c15-4f81-a18c-4550983f6a61 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.166975 May 26 13:58:22.089374 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 196/346] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:21 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:23.105125 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d78f6f7f-09ea-40a1-9e19-1e10aa371313 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:23.105759 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d78f6f7f-09ea-40a1-9e19-1e10aa371313 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:23.112326 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d78f6f7f-09ea-40a1-9e19-1e10aa371313 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:23.112608 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d78f6f7f-09ea-40a1-9e19-1e10aa371313 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:23.113428 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d78f6f7f-09ea-40a1-9e19-1e10aa371313 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:23.113871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d78f6f7f-09ea-40a1-9e19-1e10aa371313 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:23.245425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d78f6f7f-09ea-40a1-9e19-1e10aa371313 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:23.252801 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d78f6f7f-09ea-40a1-9e19-1e10aa371313 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1521 microversion: 2.1 time: 0.151509 May 26 13:58:23.253385 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 151/347] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:23 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:24.269376 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cb6e5a0f-88d6-46ba-a924-8e2ffae8b906 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:24.269964 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-cb6e5a0f-88d6-46ba-a924-8e2ffae8b906 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:24.276553 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cb6e5a0f-88d6-46ba-a924-8e2ffae8b906 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:24.277011 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cb6e5a0f-88d6-46ba-a924-8e2ffae8b906 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:24.277928 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cb6e5a0f-88d6-46ba-a924-8e2ffae8b906 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:24.278259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cb6e5a0f-88d6-46ba-a924-8e2ffae8b906 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:24.439232 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cb6e5a0f-88d6-46ba-a924-8e2ffae8b906 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:24.447486 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-cb6e5a0f-88d6-46ba-a924-8e2ffae8b906 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1501 microversion: 2.1 time: 0.181896 May 26 13:58:24.448054 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 197/348] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:24 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1501 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:24.463308 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c87a916f-5f5b-4db1-a634-5fdec0b9e70d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:24.464520 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c87a916f-5f5b-4db1-a634-5fdec0b9e70d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:24.467597 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=42 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:24.472535 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c87a916f-5f5b-4db1-a634-5fdec0b9e70d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:24.475242 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c87a916f-5f5b-4db1-a634-5fdec0b9e70d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:24.476376 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c87a916f-5f5b-4db1-a634-5fdec0b9e70d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:24.476721 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c87a916f-5f5b-4db1-a634-5fdec0b9e70d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:24.641405 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c87a916f-5f5b-4db1-a634-5fdec0b9e70d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:24.649095 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c87a916f-5f5b-4db1-a634-5fdec0b9e70d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1515 microversion: 2.1 time: 0.189505 May 26 13:58:24.649845 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 152/349] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:24 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1515 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:27.096834 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c2a38f01-4267-4879-a44c-6ea1182c7dfa tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:58:27.097858 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c2a38f01-4267-4879-a44c-6ea1182c7dfa tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:27.104114 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c2a38f01-4267-4879-a44c-6ea1182c7dfa tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:27.104568 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c2a38f01-4267-4879-a44c-6ea1182c7dfa tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:27.105361 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c2a38f01-4267-4879-a44c-6ea1182c7dfa tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:27.105797 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c2a38f01-4267-4879-a44c-6ea1182c7dfa tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:27.129674 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-c2a38f01-4267-4879-a44c-6ea1182c7dfa tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lazy-loading 'flavor' on Instance uuid b980b635-eece-4c60-9b6c-e18d32bdc7da {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:58:27.208983 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c2a38f01-4267-4879-a44c-6ea1182c7dfa tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "POST /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da/action" status: 200 len: 32 microversion: 2.1 time: 0.116105 May 26 13:58:27.209619 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 198/350] 10.222.0.91 () {60 vars in 1277 bytes} [Thu May 26 13:58:27 2022] POST /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da/action => generated 32 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 13:58:27.219772 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c8789269-6421-4b6e-9671-b23fa5df9874 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:27.220378 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c8789269-6421-4b6e-9671-b23fa5df9874 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:27.228439 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c8789269-6421-4b6e-9671-b23fa5df9874 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:27.228897 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c8789269-6421-4b6e-9671-b23fa5df9874 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:27.229928 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c8789269-6421-4b6e-9671-b23fa5df9874 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:27.230552 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c8789269-6421-4b6e-9671-b23fa5df9874 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:27.234132 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=91 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:27.487931 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c8789269-6421-4b6e-9671-b23fa5df9874 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:27.496501 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c8789269-6421-4b6e-9671-b23fa5df9874 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.281543 May 26 13:58:27.497438 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 153/351] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:27 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:28.514830 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-002ebff1-7743-4574-847c-1fe85ec01c3b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:28.515521 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-002ebff1-7743-4574-847c-1fe85ec01c3b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:28.521796 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-002ebff1-7743-4574-847c-1fe85ec01c3b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:28.522237 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-002ebff1-7743-4574-847c-1fe85ec01c3b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:28.523000 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-002ebff1-7743-4574-847c-1fe85ec01c3b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:28.523425 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-002ebff1-7743-4574-847c-1fe85ec01c3b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:28.652059 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-002ebff1-7743-4574-847c-1fe85ec01c3b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:28.659540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-002ebff1-7743-4574-847c-1fe85ec01c3b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.149484 May 26 13:58:28.660097 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 199/352] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:28 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:29.676538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bfbeed5f-feee-4850-b48e-b379f42703fe tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:29.677170 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bfbeed5f-feee-4850-b48e-b379f42703fe tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:29.684433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bfbeed5f-feee-4850-b48e-b379f42703fe tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:29.684874 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bfbeed5f-feee-4850-b48e-b379f42703fe tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:29.685696 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bfbeed5f-feee-4850-b48e-b379f42703fe tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:29.686165 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bfbeed5f-feee-4850-b48e-b379f42703fe tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:29.814032 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bfbeed5f-feee-4850-b48e-b379f42703fe tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:29.821645 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bfbeed5f-feee-4850-b48e-b379f42703fe tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.149108 May 26 13:58:29.822205 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 154/353] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:29 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:30.839205 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-29278d93-b5f2-425d-84d8-ec13cf3ef410 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:30.839794 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-29278d93-b5f2-425d-84d8-ec13cf3ef410 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:30.846618 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-29278d93-b5f2-425d-84d8-ec13cf3ef410 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:30.847068 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-29278d93-b5f2-425d-84d8-ec13cf3ef410 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:30.847834 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-29278d93-b5f2-425d-84d8-ec13cf3ef410 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:30.848264 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-29278d93-b5f2-425d-84d8-ec13cf3ef410 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:30.980870 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-29278d93-b5f2-425d-84d8-ec13cf3ef410 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:30.988900 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-29278d93-b5f2-425d-84d8-ec13cf3ef410 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.153631 May 26 13:58:30.989494 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 200/354] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:30 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:32.005852 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8f6d6b35-dc2b-4457-aef8-67cbb98b5e75 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:32.006691 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8f6d6b35-dc2b-4457-aef8-67cbb98b5e75 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:32.013169 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8f6d6b35-dc2b-4457-aef8-67cbb98b5e75 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:32.013617 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8f6d6b35-dc2b-4457-aef8-67cbb98b5e75 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:32.014374 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8f6d6b35-dc2b-4457-aef8-67cbb98b5e75 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:32.014960 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8f6d6b35-dc2b-4457-aef8-67cbb98b5e75 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:32.186055 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8f6d6b35-dc2b-4457-aef8-67cbb98b5e75 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:32.193627 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8f6d6b35-dc2b-4457-aef8-67cbb98b5e75 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.191774 May 26 13:58:32.194751 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 155/355] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:32 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:33.211122 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2493f449-8f26-478b-b84b-d8dad6e5010b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:33.211723 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2493f449-8f26-478b-b84b-d8dad6e5010b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:33.218423 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2493f449-8f26-478b-b84b-d8dad6e5010b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:33.219032 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2493f449-8f26-478b-b84b-d8dad6e5010b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:33.220005 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2493f449-8f26-478b-b84b-d8dad6e5010b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:33.220548 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2493f449-8f26-478b-b84b-d8dad6e5010b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:33.223700 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:33.359559 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2493f449-8f26-478b-b84b-d8dad6e5010b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:33.370836 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2493f449-8f26-478b-b84b-d8dad6e5010b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.163476 May 26 13:58:33.371502 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 201/356] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:33 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:34.387688 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a99a6481-22b1-4024-ab52-15133505ff35 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:34.388329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a99a6481-22b1-4024-ab52-15133505ff35 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:34.394787 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a99a6481-22b1-4024-ab52-15133505ff35 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:34.395262 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a99a6481-22b1-4024-ab52-15133505ff35 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:34.396027 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a99a6481-22b1-4024-ab52-15133505ff35 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:34.396489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a99a6481-22b1-4024-ab52-15133505ff35 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:34.534075 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a99a6481-22b1-4024-ab52-15133505ff35 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:34.541511 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a99a6481-22b1-4024-ab52-15133505ff35 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.157622 May 26 13:58:34.542085 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 156/357] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:34 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:35.558611 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7c885a90-9967-4d3f-a4c3-aa4ea4c89b8a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:35.559221 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7c885a90-9967-4d3f-a4c3-aa4ea4c89b8a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:35.565380 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7c885a90-9967-4d3f-a4c3-aa4ea4c89b8a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:35.565841 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7c885a90-9967-4d3f-a4c3-aa4ea4c89b8a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:35.566615 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7c885a90-9967-4d3f-a4c3-aa4ea4c89b8a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:35.567049 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7c885a90-9967-4d3f-a4c3-aa4ea4c89b8a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:35.695717 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7c885a90-9967-4d3f-a4c3-aa4ea4c89b8a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:35.703684 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7c885a90-9967-4d3f-a4c3-aa4ea4c89b8a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.149029 May 26 13:58:35.704260 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 202/358] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:35 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:36.720420 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-67bb66ee-63af-4306-a27d-4ca02c977621 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:36.721012 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-67bb66ee-63af-4306-a27d-4ca02c977621 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:36.727498 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-67bb66ee-63af-4306-a27d-4ca02c977621 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:36.727942 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-67bb66ee-63af-4306-a27d-4ca02c977621 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:36.728690 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-67bb66ee-63af-4306-a27d-4ca02c977621 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:36.729116 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-67bb66ee-63af-4306-a27d-4ca02c977621 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:36.862347 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-67bb66ee-63af-4306-a27d-4ca02c977621 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:36.871712 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-67bb66ee-63af-4306-a27d-4ca02c977621 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.154911 May 26 13:58:36.872908 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 157/359] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:36 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:37.889174 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e6321cbb-cde0-4ab1-a44d-4527ac3576a0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:37.889774 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e6321cbb-cde0-4ab1-a44d-4527ac3576a0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:37.895845 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e6321cbb-cde0-4ab1-a44d-4527ac3576a0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:37.896290 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e6321cbb-cde0-4ab1-a44d-4527ac3576a0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:37.897039 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e6321cbb-cde0-4ab1-a44d-4527ac3576a0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:37.897681 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e6321cbb-cde0-4ab1-a44d-4527ac3576a0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:38.027203 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e6321cbb-cde0-4ab1-a44d-4527ac3576a0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:38.037614 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e6321cbb-cde0-4ab1-a44d-4527ac3576a0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.152247 May 26 13:58:38.038358 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 203/360] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:37 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:39.054312 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f5b0755b-a08f-484f-a0b9-34da1c8ece0e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:39.054905 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f5b0755b-a08f-484f-a0b9-34da1c8ece0e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:39.061953 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f5b0755b-a08f-484f-a0b9-34da1c8ece0e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:39.062395 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f5b0755b-a08f-484f-a0b9-34da1c8ece0e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:39.063146 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f5b0755b-a08f-484f-a0b9-34da1c8ece0e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:39.063576 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f5b0755b-a08f-484f-a0b9-34da1c8ece0e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:39.199398 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f5b0755b-a08f-484f-a0b9-34da1c8ece0e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:39.206712 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f5b0755b-a08f-484f-a0b9-34da1c8ece0e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.156198 May 26 13:58:39.207269 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 158/361] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:39 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:40.223702 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0a539bcf-97fa-4661-914a-cc337ffd734c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:40.224308 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0a539bcf-97fa-4661-914a-cc337ffd734c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:40.234262 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0a539bcf-97fa-4661-914a-cc337ffd734c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:40.234262 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0a539bcf-97fa-4661-914a-cc337ffd734c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:40.234262 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0a539bcf-97fa-4661-914a-cc337ffd734c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:40.234262 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0a539bcf-97fa-4661-914a-cc337ffd734c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:40.357203 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0a539bcf-97fa-4661-914a-cc337ffd734c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:40.364501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0a539bcf-97fa-4661-914a-cc337ffd734c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.144662 May 26 13:58:40.365063 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 204/362] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:40 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:41.381017 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-efc667fa-a606-43a2-8f41-dcf8ffc2ff5a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:41.381638 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-efc667fa-a606-43a2-8f41-dcf8ffc2ff5a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:41.388659 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-efc667fa-a606-43a2-8f41-dcf8ffc2ff5a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:41.389101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-efc667fa-a606-43a2-8f41-dcf8ffc2ff5a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:41.389880 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-efc667fa-a606-43a2-8f41-dcf8ffc2ff5a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:41.390311 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-efc667fa-a606-43a2-8f41-dcf8ffc2ff5a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:41.513671 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-efc667fa-a606-43a2-8f41-dcf8ffc2ff5a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:41.521080 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-efc667fa-a606-43a2-8f41-dcf8ffc2ff5a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.143848 May 26 13:58:41.521661 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 159/363] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:41 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:42.537130 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ae116b6a-3388-45b0-a7c7-52d50154f817 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:42.537784 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ae116b6a-3388-45b0-a7c7-52d50154f817 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:42.543731 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ae116b6a-3388-45b0-a7c7-52d50154f817 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:42.544183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ae116b6a-3388-45b0-a7c7-52d50154f817 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:42.544922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ae116b6a-3388-45b0-a7c7-52d50154f817 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:42.545372 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ae116b6a-3388-45b0-a7c7-52d50154f817 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:42.895544 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ae116b6a-3388-45b0-a7c7-52d50154f817 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:42.903165 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ae116b6a-3388-45b0-a7c7-52d50154f817 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.369767 May 26 13:58:42.903728 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 205/364] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:42 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:43.920314 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7f1f00be-0eb0-4167-891d-5e1c4e19e120 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:43.920827 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7f1f00be-0eb0-4167-891d-5e1c4e19e120 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:43.927257 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7f1f00be-0eb0-4167-891d-5e1c4e19e120 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:43.927702 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7f1f00be-0eb0-4167-891d-5e1c4e19e120 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:43.928450 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7f1f00be-0eb0-4167-891d-5e1c4e19e120 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:43.928880 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7f1f00be-0eb0-4167-891d-5e1c4e19e120 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:44.052797 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7f1f00be-0eb0-4167-891d-5e1c4e19e120 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:44.060280 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7f1f00be-0eb0-4167-891d-5e1c4e19e120 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.144423 May 26 13:58:44.060842 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 160/365] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:43 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:45.076603 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-eb5b8911-0062-48d2-a5c6-d0019d9312fc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:45.077224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-eb5b8911-0062-48d2-a5c6-d0019d9312fc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:45.083165 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb5b8911-0062-48d2-a5c6-d0019d9312fc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:45.083630 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb5b8911-0062-48d2-a5c6-d0019d9312fc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:45.084391 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb5b8911-0062-48d2-a5c6-d0019d9312fc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:45.084825 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb5b8911-0062-48d2-a5c6-d0019d9312fc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:45.218109 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-eb5b8911-0062-48d2-a5c6-d0019d9312fc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:45.225549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-eb5b8911-0062-48d2-a5c6-d0019d9312fc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.152797 May 26 13:58:45.226148 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 206/366] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:45 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:46.243100 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-aedeff87-6a81-44f6-9326-396fc4036635 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:46.243712 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-aedeff87-6a81-44f6-9326-396fc4036635 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:46.251098 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aedeff87-6a81-44f6-9326-396fc4036635 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:46.251546 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aedeff87-6a81-44f6-9326-396fc4036635 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:46.252308 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aedeff87-6a81-44f6-9326-396fc4036635 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:46.253193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aedeff87-6a81-44f6-9326-396fc4036635 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:46.376611 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-aedeff87-6a81-44f6-9326-396fc4036635 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:46.383913 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-aedeff87-6a81-44f6-9326-396fc4036635 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.144712 May 26 13:58:46.384473 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 161/367] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:46 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:47.399754 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-339e715c-5dd9-4c51-8b41-25c2c073f342 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:47.400605 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-339e715c-5dd9-4c51-8b41-25c2c073f342 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:47.406693 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-339e715c-5dd9-4c51-8b41-25c2c073f342 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:47.407132 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-339e715c-5dd9-4c51-8b41-25c2c073f342 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:47.407874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-339e715c-5dd9-4c51-8b41-25c2c073f342 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:47.408301 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-339e715c-5dd9-4c51-8b41-25c2c073f342 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:47.538348 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-339e715c-5dd9-4c51-8b41-25c2c073f342 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:47.545933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-339e715c-5dd9-4c51-8b41-25c2c073f342 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.150009 May 26 13:58:47.546492 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 207/368] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:47 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:48.563573 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a9a32534-3cf5-4b7b-b285-e6d46f104830 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:48.564108 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a9a32534-3cf5-4b7b-b285-e6d46f104830 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:48.570631 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a9a32534-3cf5-4b7b-b285-e6d46f104830 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:48.571087 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a9a32534-3cf5-4b7b-b285-e6d46f104830 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:48.571843 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a9a32534-3cf5-4b7b-b285-e6d46f104830 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:48.572278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a9a32534-3cf5-4b7b-b285-e6d46f104830 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:48.695951 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a9a32534-3cf5-4b7b-b285-e6d46f104830 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:48.703902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a9a32534-3cf5-4b7b-b285-e6d46f104830 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.144233 May 26 13:58:48.704467 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 162/369] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:48 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:49.720963 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6472901b-6aa3-487f-a63c-1dab08291001 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:49.721606 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6472901b-6aa3-487f-a63c-1dab08291001 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:49.727883 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6472901b-6aa3-487f-a63c-1dab08291001 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:49.728471 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6472901b-6aa3-487f-a63c-1dab08291001 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:49.729289 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6472901b-6aa3-487f-a63c-1dab08291001 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:49.729806 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6472901b-6aa3-487f-a63c-1dab08291001 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:49.857865 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6472901b-6aa3-487f-a63c-1dab08291001 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:49.865366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6472901b-6aa3-487f-a63c-1dab08291001 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.148152 May 26 13:58:49.865918 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 208/370] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:49 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:50.881590 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-724c1e26-0a06-437c-9a0d-d6b6ebade19e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:50.882212 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-724c1e26-0a06-437c-9a0d-d6b6ebade19e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:50.888516 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-724c1e26-0a06-437c-9a0d-d6b6ebade19e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:50.888971 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-724c1e26-0a06-437c-9a0d-d6b6ebade19e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:50.889778 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-724c1e26-0a06-437c-9a0d-d6b6ebade19e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:50.890219 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-724c1e26-0a06-437c-9a0d-d6b6ebade19e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:51.018713 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-724c1e26-0a06-437c-9a0d-d6b6ebade19e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:51.026387 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-724c1e26-0a06-437c-9a0d-d6b6ebade19e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.148550 May 26 13:58:51.026950 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 163/371] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:50 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:52.043941 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0dda6c68-bb39-43dc-903a-d4f1d2c83ffe tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:52.044828 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0dda6c68-bb39-43dc-903a-d4f1d2c83ffe tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:52.046696 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=26 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:52.052334 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0dda6c68-bb39-43dc-903a-d4f1d2c83ffe tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:52.052778 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0dda6c68-bb39-43dc-903a-d4f1d2c83ffe tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:52.053614 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0dda6c68-bb39-43dc-903a-d4f1d2c83ffe tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:52.054021 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0dda6c68-bb39-43dc-903a-d4f1d2c83ffe tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:52.181865 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0dda6c68-bb39-43dc-903a-d4f1d2c83ffe tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:52.189995 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0dda6c68-bb39-43dc-903a-d4f1d2c83ffe tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.150796 May 26 13:58:52.190567 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 209/372] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:52 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:53.208435 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d437c2f9-12a2-4d7a-9944-c0f53670984a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:53.209073 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d437c2f9-12a2-4d7a-9944-c0f53670984a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:53.216305 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d437c2f9-12a2-4d7a-9944-c0f53670984a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:53.216760 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d437c2f9-12a2-4d7a-9944-c0f53670984a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:53.217561 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d437c2f9-12a2-4d7a-9944-c0f53670984a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:53.218000 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d437c2f9-12a2-4d7a-9944-c0f53670984a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:53.402128 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d437c2f9-12a2-4d7a-9944-c0f53670984a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:53.410162 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d437c2f9-12a2-4d7a-9944-c0f53670984a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.207011 May 26 13:58:53.410776 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 164/373] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:53 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:54.427247 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d05752ae-104d-4428-ba75-b412ed086067 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:54.427757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d05752ae-104d-4428-ba75-b412ed086067 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:54.433666 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d05752ae-104d-4428-ba75-b412ed086067 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:54.434126 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d05752ae-104d-4428-ba75-b412ed086067 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:54.434880 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d05752ae-104d-4428-ba75-b412ed086067 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:54.435305 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d05752ae-104d-4428-ba75-b412ed086067 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:54.573123 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d05752ae-104d-4428-ba75-b412ed086067 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:54.581195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d05752ae-104d-4428-ba75-b412ed086067 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.157889 May 26 13:58:54.581788 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 210/374] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:54 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:55.598483 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6858e5cd-0930-421c-bb2b-40368f7b2cf1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:55.599089 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6858e5cd-0930-421c-bb2b-40368f7b2cf1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:55.601433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=26 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:55.607335 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6858e5cd-0930-421c-bb2b-40368f7b2cf1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:55.607780 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6858e5cd-0930-421c-bb2b-40368f7b2cf1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:55.608540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6858e5cd-0930-421c-bb2b-40368f7b2cf1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:55.609189 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6858e5cd-0930-421c-bb2b-40368f7b2cf1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:55.835071 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6858e5cd-0930-421c-bb2b-40368f7b2cf1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:55.842970 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6858e5cd-0930-421c-bb2b-40368f7b2cf1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1501 microversion: 2.1 time: 0.248240 May 26 13:58:55.843754 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 165/375] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:55 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1501 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:55.861836 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6baa6136-2497-4395-a132-2d7e975a9f8e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12e9e69d-47f4-4f6b-967c-8778bb6cfbda"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:58:55.862932 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6baa6136-2497-4395-a132-2d7e975a9f8e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:55.869898 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6baa6136-2497-4395-a132-2d7e975a9f8e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:55.870906 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6baa6136-2497-4395-a132-2d7e975a9f8e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:55.872276 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6baa6136-2497-4395-a132-2d7e975a9f8e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:55.872712 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6baa6136-2497-4395-a132-2d7e975a9f8e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:55.901171 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-6baa6136-2497-4395-a132-2d7e975a9f8e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] HTTP exception thrown: Cannot 'attach_volume' instance b980b635-eece-4c60-9b6c-e18d32bdc7da while it is in vm_state rescued May 26 13:58:55.902949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6baa6136-2497-4395-a132-2d7e975a9f8e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Request method failure captured: May 26 13:58:55.902949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: POST /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da/os-volume_attachments HTTP/1.1 May 26 13:58:55.902949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 13:58:55.902949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 13:58:55.902949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 13:58:55.902949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 74 May 26 13:58:55.902949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 13:58:55.902949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 13:58:55.902949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 13:58:55.902949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 13:58:55.902949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4b-Oa-X6jHN9Gz0z18y08tbmRNqhQxYbg6e0BLZYdSYeIsEe3D2y9tpoIKpFY4nKChjusqnkMX7zTWBNnntrwanhfW05syDJiYjjEY8aLgU67Tthga-5NQqGGlNnebZErUKMhE2yG3kiGK5Z82LAT1fimq3qIuG9eMK6nluEM7g7pc May 26 13:58:55.902949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 13:58:55.902949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 13:58:55.902949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 13:58:55.902949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 13:58:55.902949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 13:58:55.902949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 13:58:55.902949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: e3d27b9eb0ef4c338c18c2a1d02db444 May 26 13:58:55.902949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1535794059 May 26 13:58:55.902949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 13:58:55.902949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 13:58:55.904500 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/e3d27b9eb0ef4c338c18c2a1d02db444"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/e3d27b9eb0ef4c338c18c2a1d02db444"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/e3d27b9eb0ef4c338c18c2a1d02db444"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_e3d27b9eb0ef4c338c18c2a1d02db444", "adminURL": "http://10.222.0.91:8080"}]}] May 26 13:58:55.904500 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1535794059 May 26 13:58:55.904500 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: e3d27b9eb0ef4c338c18c2a1d02db444 May 26 13:58:55.904500 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1535794059 May 26 13:58:55.904500 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-ServerRescueNegativeTestJSON-1535794059-project May 26 13:58:55.904500 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 13:58:55.904500 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 13:58:55.904500 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: 8d7bcc48c8d844e5b36b1c4e2748e766 May 26 13:58:55.904500 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1535794059-project May 26 13:58:55.904500 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: May 26 13:58:55.904500 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {"volumeAttachment": {"volumeId": "12e9e69d-47f4-4f6b-967c-8778bb6cfbda"}} May 26 13:58:55.904500 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 13:58:55.905509 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Cannot 'attach_volume' instance b980b635-eece-4c60-9b6c-e18d32bdc7da while it is in vm_state rescued May 26 13:58:55.905509 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'server_id': 'b980b635-eece-4c60-9b6c-e18d32bdc7da', 'body': {'volumeAttachment': {'volumeId': '12e9e69d-47f4-4f6b-967c-8778bb6cfbda'}}} May 26 13:58:55.905509 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:58:55.905509 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:58:55.905509 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 13:58:55.905509 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 13:58:55.905509 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 13:58:55.905509 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 13:58:55.905509 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 13:58:55.905509 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 13:58:55.905509 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b980b635-eece-4c60-9b6c-e18d32bdc7da in vm_state rescued. Cannot attach_volume while the instance is in this state. May 26 13:58:55.905509 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:58:55.905509 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:58:55.905509 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:58:55.905509 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:58:55.905509 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:58:55.905509 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:58:55.905509 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:58:55.905509 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:58:55.906931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:58:55.906931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:58:55.906931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 13:58:55.906931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 13:58:55.906931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 13:58:55.906931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 13:58:55.906931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 13:58:55.906931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 13:58:55.906931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 26 13:58:55.906931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 13:58:55.906931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 13:58:55.906931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 13:58:55.906931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b980b635-eece-4c60-9b6c-e18d32bdc7da while it is in vm_state rescued May 26 13:58:55.906931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:58:55.906931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:58:55.906931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:58:55.906931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:58:55.906931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:58:55.906931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:58:55.908890 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:58:55.908890 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:58:55.908890 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b980b635-eece-4c60-9b6c-e18d32bdc7da while it is in vm_state rescued May 26 13:58:55.908890 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 13:58:55.908890 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6baa6136-2497-4395-a132-2d7e975a9f8e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Returning 409 to user: Cannot 'attach_volume' instance b980b635-eece-4c60-9b6c-e18d32bdc7da while it is in vm_state rescued {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:58:55.908890 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6baa6136-2497-4395-a132-2d7e975a9f8e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "POST /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047521 May 26 13:58:55.908890 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 211/376] 10.222.0.91 () {60 vars in 1322 bytes} [Thu May 26 13:58:55 2022] POST /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 13:58:55.914737 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-05760525-f5fe-495f-bc16-56d57282ec40 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:58:55.915272 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-05760525-f5fe-495f-bc16-56d57282ec40 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:55.921445 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05760525-f5fe-495f-bc16-56d57282ec40 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:55.921897 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05760525-f5fe-495f-bc16-56d57282ec40 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:55.922664 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05760525-f5fe-495f-bc16-56d57282ec40 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:55.923098 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05760525-f5fe-495f-bc16-56d57282ec40 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:56.001355 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-05760525-f5fe-495f-bc16-56d57282ec40 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "POST /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da/action" status: 202 len: 0 microversion: 2.1 time: 0.090180 May 26 13:58:56.002186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 166/377] 10.222.0.91 () {60 vars in 1277 bytes} [Thu May 26 13:58:55 2022] POST /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:58:56.011503 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-61931976-ab37-41e0-a1da-6507d7798974 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:56.012877 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-61931976-ab37-41e0-a1da-6507d7798974 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:56.021770 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-61931976-ab37-41e0-a1da-6507d7798974 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:56.023259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-61931976-ab37-41e0-a1da-6507d7798974 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:56.024423 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-61931976-ab37-41e0-a1da-6507d7798974 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:56.025392 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-61931976-ab37-41e0-a1da-6507d7798974 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:56.313815 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-61931976-ab37-41e0-a1da-6507d7798974 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:56.323942 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-61931976-ab37-41e0-a1da-6507d7798974 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1509 microversion: 2.1 time: 0.317160 May 26 13:58:56.324421 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 212/378] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:56 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1509 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:58:57.356856 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-05e1c2cf-0b1e-4e67-acba-afbc12d95997 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:57.357515 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-05e1c2cf-0b1e-4e67-acba-afbc12d95997 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:57.373756 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05e1c2cf-0b1e-4e67-acba-afbc12d95997 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:57.375133 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05e1c2cf-0b1e-4e67-acba-afbc12d95997 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:57.376172 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05e1c2cf-0b1e-4e67-acba-afbc12d95997 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:57.376686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05e1c2cf-0b1e-4e67-acba-afbc12d95997 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:57.381395 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:57.548084 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-05e1c2cf-0b1e-4e67-acba-afbc12d95997 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:57.558862 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-05e1c2cf-0b1e-4e67-acba-afbc12d95997 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1509 microversion: 2.1 time: 0.220469 May 26 13:58:57.560321 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 167/379] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:57 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1509 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:58.578190 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a5bb5539-bc52-4175-96ce-cf4fabfc2659 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:58.579373 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a5bb5539-bc52-4175-96ce-cf4fabfc2659 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:58.588965 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a5bb5539-bc52-4175-96ce-cf4fabfc2659 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:58.589441 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a5bb5539-bc52-4175-96ce-cf4fabfc2659 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:58.590882 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a5bb5539-bc52-4175-96ce-cf4fabfc2659 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:58.591330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a5bb5539-bc52-4175-96ce-cf4fabfc2659 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:58.752308 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a5bb5539-bc52-4175-96ce-cf4fabfc2659 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:58.761439 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a5bb5539-bc52-4175-96ce-cf4fabfc2659 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1509 microversion: 2.1 time: 0.187497 May 26 13:58:58.762858 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 213/380] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:58 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:59.781733 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d575c225-1283-4245-b3c9-195eaa780043 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:59.782338 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d575c225-1283-4245-b3c9-195eaa780043 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:59.788938 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d575c225-1283-4245-b3c9-195eaa780043 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:59.789591 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d575c225-1283-4245-b3c9-195eaa780043 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:59.790353 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d575c225-1283-4245-b3c9-195eaa780043 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:59.790785 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d575c225-1283-4245-b3c9-195eaa780043 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:59.944863 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d575c225-1283-4245-b3c9-195eaa780043 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:59.956857 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d575c225-1283-4245-b3c9-195eaa780043 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1509 microversion: 2.1 time: 0.178638 May 26 13:58:59.957938 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 168/381] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:58:59 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:00.973955 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-05427949-8025-43f8-9c57-d37a46c696ba tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:00.974582 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-05427949-8025-43f8-9c57-d37a46c696ba tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:00.981578 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-05427949-8025-43f8-9c57-d37a46c696ba tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:00.982033 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-05427949-8025-43f8-9c57-d37a46c696ba tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:00.982801 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-05427949-8025-43f8-9c57-d37a46c696ba tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:00.983407 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-05427949-8025-43f8-9c57-d37a46c696ba tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:01.119399 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-05427949-8025-43f8-9c57-d37a46c696ba tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:01.127091 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-05427949-8025-43f8-9c57-d37a46c696ba tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1509 microversion: 2.1 time: 0.156993 May 26 13:59:01.127658 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 214/382] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:00 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:01.130314 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d4b50389-5781-4daa-9779-1523ea551ce7 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1772870429", "imageRef": "bcaacfae-fe2c-455f-a6e1-b08361c6fa8c", "flavorRef": "452", "networks": [{"uuid": "3c753870-7084-433e-b67c-0097f665e28b"}]}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:59:01.186145 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-d4b50389-5781-4daa-9779-1523ea551ce7 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] validate_networks() for [('3c753870-7084-433e-b67c-0097f665e28b', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:59:01.536424 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-d4b50389-5781-4daa-9779-1523ea551ce7 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:59:01.536875 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-d4b50389-5781-4daa-9779-1523ea551ce7 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:59:01.537383 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-d4b50389-5781-4daa-9779-1523ea551ce7 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:59:01.537786 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-d4b50389-5781-4daa-9779-1523ea551ce7 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:59:01.538190 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-d4b50389-5781-4daa-9779-1523ea551ce7 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:59:01.547505 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d4b50389-5781-4daa-9779-1523ea551ce7 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:01.547942 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d4b50389-5781-4daa-9779-1523ea551ce7 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:01.548740 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d4b50389-5781-4daa-9779-1523ea551ce7 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:01.549200 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d4b50389-5781-4daa-9779-1523ea551ce7 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:01.568410 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-d4b50389-5781-4daa-9779-1523ea551ce7 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Getting quotas for project 12082647641d4ece974c66384e3bf169. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:59:01.572458 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-d4b50389-5781-4daa-9779-1523ea551ce7 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Getting quotas for user 2eb759cf823b45d2aa35fdcacc7ac3e8 and project 12082647641d4ece974c66384e3bf169. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:59:01.583167 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d4b50389-5781-4daa-9779-1523ea551ce7 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:59:01.585602 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d4b50389-5781-4daa-9779-1523ea551ce7 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bcaacfae-fe2c-455f-a6e1-b08361c6fa8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:59:01.631813 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d4b50389-5781-4daa-9779-1523ea551ce7 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505369 May 26 13:59:01.632440 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 169/383] 10.222.0.91 () {60 vars in 1146 bytes} [Thu May 26 13:59:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:59:01.642680 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-899f5fd5-284b-42aa-82c8-19e2cc85bc5f tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:01.643367 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-899f5fd5-284b-42aa-82c8-19e2cc85bc5f tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:01.696357 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-899f5fd5-284b-42aa-82c8-19e2cc85bc5f tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:01.704545 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-899f5fd5-284b-42aa-82c8-19e2cc85bc5f tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1214 microversion: 2.1 time: 0.066029 May 26 13:59:01.705372 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 215/384] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:01 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:02.145118 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7c16b387-1957-4cce-8c67-97e6d87e46fb tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:02.150236 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7c16b387-1957-4cce-8c67-97e6d87e46fb tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:02.158654 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7c16b387-1957-4cce-8c67-97e6d87e46fb tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:02.176993 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7c16b387-1957-4cce-8c67-97e6d87e46fb tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:02.179549 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7c16b387-1957-4cce-8c67-97e6d87e46fb tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:02.185385 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7c16b387-1957-4cce-8c67-97e6d87e46fb tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:02.359619 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7c16b387-1957-4cce-8c67-97e6d87e46fb tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:02.367676 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7c16b387-1957-4cce-8c67-97e6d87e46fb tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1515 microversion: 2.1 time: 0.227481 May 26 13:59:02.368250 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 170/385] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:02 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1515 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:02.720840 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b26dc3b9-641b-4da4-9f38-c365f501019a tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:02.721367 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b26dc3b9-641b-4da4-9f38-c365f501019a tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:02.727747 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b26dc3b9-641b-4da4-9f38-c365f501019a tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:02.728201 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b26dc3b9-641b-4da4-9f38-c365f501019a tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:02.728963 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b26dc3b9-641b-4da4-9f38-c365f501019a tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:02.729445 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b26dc3b9-641b-4da4-9f38-c365f501019a tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:02.803941 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b26dc3b9-641b-4da4-9f38-c365f501019a tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:02.812364 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b26dc3b9-641b-4da4-9f38-c365f501019a tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1274 microversion: 2.1 time: 0.095419 May 26 13:59:02.813963 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 216/386] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:02 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1274 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:03.829608 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f100cec4-4e70-4426-b5a7-918da49996ed tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:03.830132 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f100cec4-4e70-4426-b5a7-918da49996ed tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:03.836499 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f100cec4-4e70-4426-b5a7-918da49996ed tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:03.836947 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f100cec4-4e70-4426-b5a7-918da49996ed tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:03.837736 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f100cec4-4e70-4426-b5a7-918da49996ed tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:03.838187 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f100cec4-4e70-4426-b5a7-918da49996ed tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:03.964123 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f100cec4-4e70-4426-b5a7-918da49996ed tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:03.972085 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f100cec4-4e70-4426-b5a7-918da49996ed tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1314 microversion: 2.1 time: 0.146374 May 26 13:59:03.972651 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 171/387] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:03 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:59:04.989611 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ab19790c-a445-4ce8-b8df-93b3b874386b tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:04.990132 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ab19790c-a445-4ce8-b8df-93b3b874386b tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:04.996093 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ab19790c-a445-4ce8-b8df-93b3b874386b tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:04.997101 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ab19790c-a445-4ce8-b8df-93b3b874386b tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:04.997883 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ab19790c-a445-4ce8-b8df-93b3b874386b tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:04.998308 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ab19790c-a445-4ce8-b8df-93b3b874386b tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:05.000808 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=88 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:05.120452 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ab19790c-a445-4ce8-b8df-93b3b874386b tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:05.128377 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ab19790c-a445-4ce8-b8df-93b3b874386b tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1314 microversion: 2.1 time: 0.142713 May 26 13:59:05.128938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 217/388] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:04 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:06.134895 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-bc0b5d47-a352-41b7-9c33-337a7d665e05 req-9cc19ec5-b126-4e17-9243-b1d8fcccd6ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1645ce10-e28e-4a91-bc47-8ebe6a8acd0e", "tag": "fefc5ff7-7f07-4b4c-9a1f-242c2bae275e"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:59:06.144598 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-613622e6-3887-453f-b4a1-d2c1be3e602a tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:06.145142 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-bc0b5d47-a352-41b7-9c33-337a7d665e05 req-9cc19ec5-b126-4e17-9243-b1d8fcccd6ad service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:06.145142 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-bc0b5d47-a352-41b7-9c33-337a7d665e05 req-9cc19ec5-b126-4e17-9243-b1d8fcccd6ad service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:06.146233 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-613622e6-3887-453f-b4a1-d2c1be3e602a tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:06.153297 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-613622e6-3887-453f-b4a1-d2c1be3e602a tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:06.153546 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-613622e6-3887-453f-b4a1-d2c1be3e602a tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:06.154315 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-613622e6-3887-453f-b4a1-d2c1be3e602a tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:06.154750 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-613622e6-3887-453f-b4a1-d2c1be3e602a tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:06.161311 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-bc0b5d47-a352-41b7-9c33-337a7d665e05 req-9cc19ec5-b126-4e17-9243-b1d8fcccd6ad service nova] Creating event network-changed:fefc5ff7-7f07-4b4c-9a1f-242c2bae275e for instance 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e on hv-cinder-84213 May 26 13:59:06.166600 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-bc0b5d47-a352-41b7-9c33-337a7d665e05 req-9cc19ec5-b126-4e17-9243-b1d8fcccd6ad service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035757 May 26 13:59:06.167192 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 172/389] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 13:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:59:06.284851 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-613622e6-3887-453f-b4a1-d2c1be3e602a tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:06.292224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-613622e6-3887-453f-b4a1-d2c1be3e602a tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1314 microversion: 2.1 time: 0.151443 May 26 13:59:06.292790 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 218/390] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:06 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:59:07.309788 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e70e52e5-c52f-4dac-b8c9-f51f6c98d462 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:07.310395 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e70e52e5-c52f-4dac-b8c9-f51f6c98d462 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:07.317334 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e70e52e5-c52f-4dac-b8c9-f51f6c98d462 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:07.317786 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e70e52e5-c52f-4dac-b8c9-f51f6c98d462 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:07.318648 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e70e52e5-c52f-4dac-b8c9-f51f6c98d462 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:07.319084 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e70e52e5-c52f-4dac-b8c9-f51f6c98d462 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:07.720875 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e70e52e5-c52f-4dac-b8c9-f51f6c98d462 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:07.728651 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e70e52e5-c52f-4dac-b8c9-f51f6c98d462 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1314 microversion: 2.1 time: 0.423221 May 26 13:59:07.729259 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 173/391] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:07 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:08.745341 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f5941ca8-4023-466f-815f-2895e433b9ac tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:08.745870 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f5941ca8-4023-466f-815f-2895e433b9ac tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:08.752287 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f5941ca8-4023-466f-815f-2895e433b9ac tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:08.752728 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f5941ca8-4023-466f-815f-2895e433b9ac tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:08.753494 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f5941ca8-4023-466f-815f-2895e433b9ac tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:08.753919 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f5941ca8-4023-466f-815f-2895e433b9ac tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:08.891671 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f5941ca8-4023-466f-815f-2895e433b9ac tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:08.899727 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f5941ca8-4023-466f-815f-2895e433b9ac tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1314 microversion: 2.1 time: 0.158031 May 26 13:59:08.900303 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 219/392] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:08 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:08.962010 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-93a34891-b818-4989-aafa-e787be8dcd57 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Action: 'create', calling method: .version_select at 0x7f25a4e6d1f0>, body: {"keypair": {"name": "tempest-keypair-1096474030", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImD8JRGxnhlOlgmlmUpHNCuiVLe8NvUR8ih21B3tAYpeyuygCBLXrPfi7jJ4YCuiV3U4Git5DRsJI+weJeYJ42eG+2R+G0puSXbaBvSEbgnu2vhXtjTcODJDovMS0Estg=="}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:59:08.976360 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-93a34891-b818-4989-aafa-e787be8dcd57 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Getting quotas for project e3d27b9eb0ef4c338c18c2a1d02db444. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:59:08.980190 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-93a34891-b818-4989-aafa-e787be8dcd57 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Getting quotas for user 8d7bcc48c8d844e5b36b1c4e2748e766 and project e3d27b9eb0ef4c338c18c2a1d02db444. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:59:09.004548 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-93a34891-b818-4989-aafa-e787be8dcd57 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046348 May 26 13:59:09.005187 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 174/393] 10.222.0.91 () {60 vars in 1158 bytes} [Thu May 26 13:59:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:59:09.916973 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-601446ee-6669-4435-8dbd-60566fc14c08 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:09.918559 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-601446ee-6669-4435-8dbd-60566fc14c08 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:09.925646 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-601446ee-6669-4435-8dbd-60566fc14c08 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:09.926473 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-601446ee-6669-4435-8dbd-60566fc14c08 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:09.927301 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-601446ee-6669-4435-8dbd-60566fc14c08 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:09.927946 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-601446ee-6669-4435-8dbd-60566fc14c08 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:10.138823 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-601446ee-6669-4435-8dbd-60566fc14c08 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:10.146400 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-601446ee-6669-4435-8dbd-60566fc14c08 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1314 microversion: 2.1 time: 0.233687 May 26 13:59:10.147344 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 220/394] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:09 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:59:10.390624 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-564c20a0-d649-4851-91df-c827c45435b9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2019185636", "imageRef": "bcaacfae-fe2c-455f-a6e1-b08361c6fa8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94664734-1654-43f2-b262-23850dca9bb9"}], "security_groups": [{"name": "tempest-securitygroup--1883107574"}], "key_name": "tempest-keypair-1096474030", "user_data": "}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:59:10.512669 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-564c20a0-d649-4851-91df-c827c45435b9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] validate_networks() for [('94664734-1654-43f2-b262-23850dca9bb9', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:59:10.907911 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-564c20a0-d649-4851-91df-c827c45435b9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:59:10.908338 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-564c20a0-d649-4851-91df-c827c45435b9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:59:10.908814 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-564c20a0-d649-4851-91df-c827c45435b9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:59:10.909276 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-564c20a0-d649-4851-91df-c827c45435b9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:59:10.909694 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-564c20a0-d649-4851-91df-c827c45435b9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:59:10.918770 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-564c20a0-d649-4851-91df-c827c45435b9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:10.919230 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-564c20a0-d649-4851-91df-c827c45435b9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:10.920033 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-564c20a0-d649-4851-91df-c827c45435b9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:10.920499 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-564c20a0-d649-4851-91df-c827c45435b9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:10.937906 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-564c20a0-d649-4851-91df-c827c45435b9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Getting quotas for project e3d27b9eb0ef4c338c18c2a1d02db444. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:59:10.941879 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-564c20a0-d649-4851-91df-c827c45435b9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Getting quotas for user 8d7bcc48c8d844e5b36b1c4e2748e766 and project e3d27b9eb0ef4c338c18c2a1d02db444. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:59:10.954054 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-564c20a0-d649-4851-91df-c827c45435b9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:59:10.956415 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-564c20a0-d649-4851-91df-c827c45435b9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bcaacfae-fe2c-455f-a6e1-b08361c6fa8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:59:11.003831 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-564c20a0-d649-4851-91df-c827c45435b9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.617440 May 26 13:59:11.004735 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 175/395] 10.222.0.91 () {60 vars in 1146 bytes} [Thu May 26 13:59:10 2022] POST /compute/v2.1/servers => generated 409 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:59:11.015013 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-83d49e3f-0bb3-45d5-b37e-550a8081cee4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:11.016248 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-83d49e3f-0bb3-45d5-b37e-550a8081cee4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:11.102395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-83d49e3f-0bb3-45d5-b37e-550a8081cee4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:11.110055 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-83d49e3f-0bb3-45d5-b37e-550a8081cee4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1246 microversion: 2.1 time: 0.099318 May 26 13:59:11.110625 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 221/396] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:11 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1246 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:11.163238 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-89dd3ab6-bebb-482d-96e6-c828937ce899 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:11.163924 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-89dd3ab6-bebb-482d-96e6-c828937ce899 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:11.172192 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-89dd3ab6-bebb-482d-96e6-c828937ce899 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:11.172917 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-89dd3ab6-bebb-482d-96e6-c828937ce899 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:11.173894 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-89dd3ab6-bebb-482d-96e6-c828937ce899 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:11.174490 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-89dd3ab6-bebb-482d-96e6-c828937ce899 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:11.354190 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-89dd3ab6-bebb-482d-96e6-c828937ce899 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:11.363512 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-89dd3ab6-bebb-482d-96e6-c828937ce899 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1314 microversion: 2.1 time: 0.203751 May 26 13:59:11.364254 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 176/397] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:11 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:12.127437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b868f2b2-52e0-4e6a-ae32-08dc5f0d17e7 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:12.128258 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b868f2b2-52e0-4e6a-ae32-08dc5f0d17e7 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:12.134550 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b868f2b2-52e0-4e6a-ae32-08dc5f0d17e7 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:12.135103 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b868f2b2-52e0-4e6a-ae32-08dc5f0d17e7 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:12.135949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b868f2b2-52e0-4e6a-ae32-08dc5f0d17e7 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:12.136389 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b868f2b2-52e0-4e6a-ae32-08dc5f0d17e7 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:12.198181 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b868f2b2-52e0-4e6a-ae32-08dc5f0d17e7 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:12.207160 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b868f2b2-52e0-4e6a-ae32-08dc5f0d17e7 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1250 microversion: 2.1 time: 0.083622 May 26 13:59:12.207725 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 222/398] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:12 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1250 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:12.381499 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9743d235-aa37-49b5-bd1a-07d805c1ea85 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:12.382096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9743d235-aa37-49b5-bd1a-07d805c1ea85 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:12.389480 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9743d235-aa37-49b5-bd1a-07d805c1ea85 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:12.389929 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9743d235-aa37-49b5-bd1a-07d805c1ea85 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:12.390699 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9743d235-aa37-49b5-bd1a-07d805c1ea85 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:12.391134 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9743d235-aa37-49b5-bd1a-07d805c1ea85 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:12.528199 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9743d235-aa37-49b5-bd1a-07d805c1ea85 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:12.535617 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9743d235-aa37-49b5-bd1a-07d805c1ea85 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1314 microversion: 2.1 time: 0.159289 May 26 13:59:12.536371 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 177/399] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:12 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:13.223772 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-55a35f6b-d4c1-41c5-8b49-94b6f836f966 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:13.224330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-55a35f6b-d4c1-41c5-8b49-94b6f836f966 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:13.230814 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-55a35f6b-d4c1-41c5-8b49-94b6f836f966 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:13.231285 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-55a35f6b-d4c1-41c5-8b49-94b6f836f966 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:13.232036 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-55a35f6b-d4c1-41c5-8b49-94b6f836f966 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:13.232471 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-55a35f6b-d4c1-41c5-8b49-94b6f836f966 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:13.290367 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-55a35f6b-d4c1-41c5-8b49-94b6f836f966 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:13.298248 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-55a35f6b-d4c1-41c5-8b49-94b6f836f966 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1250 microversion: 2.1 time: 0.078341 May 26 13:59:13.298800 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 223/400] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:13 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1250 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:13.553027 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-32c1e0fd-1504-44fd-8a71-a2bfcaf36ea1 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:13.553610 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-32c1e0fd-1504-44fd-8a71-a2bfcaf36ea1 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:13.560616 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-32c1e0fd-1504-44fd-8a71-a2bfcaf36ea1 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:13.561059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-32c1e0fd-1504-44fd-8a71-a2bfcaf36ea1 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:13.561850 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-32c1e0fd-1504-44fd-8a71-a2bfcaf36ea1 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:13.562281 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-32c1e0fd-1504-44fd-8a71-a2bfcaf36ea1 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:13.690123 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-32c1e0fd-1504-44fd-8a71-a2bfcaf36ea1 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:13.697727 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-32c1e0fd-1504-44fd-8a71-a2bfcaf36ea1 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1314 microversion: 2.1 time: 0.148552 May 26 13:59:13.698334 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 178/401] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:13 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:14.314888 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4ec5b1e0-bd4d-42dd-9622-0647fc459d24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:14.315385 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4ec5b1e0-bd4d-42dd-9622-0647fc459d24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:14.321329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4ec5b1e0-bd4d-42dd-9622-0647fc459d24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:14.321765 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4ec5b1e0-bd4d-42dd-9622-0647fc459d24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:14.322508 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4ec5b1e0-bd4d-42dd-9622-0647fc459d24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:14.322937 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4ec5b1e0-bd4d-42dd-9622-0647fc459d24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:14.380885 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4ec5b1e0-bd4d-42dd-9622-0647fc459d24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:14.389692 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4ec5b1e0-bd4d-42dd-9622-0647fc459d24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1250 microversion: 2.1 time: 0.078688 May 26 13:59:14.390249 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 224/402] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:14 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1250 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:14.714524 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3b3520ff-a714-45b5-b833-5ccd2aa756f4 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:14.715682 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3b3520ff-a714-45b5-b833-5ccd2aa756f4 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:14.722133 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3b3520ff-a714-45b5-b833-5ccd2aa756f4 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:14.722571 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3b3520ff-a714-45b5-b833-5ccd2aa756f4 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:14.723646 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3b3520ff-a714-45b5-b833-5ccd2aa756f4 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:14.724179 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3b3520ff-a714-45b5-b833-5ccd2aa756f4 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:14.872904 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3b3520ff-a714-45b5-b833-5ccd2aa756f4 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:14.880917 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3b3520ff-a714-45b5-b833-5ccd2aa756f4 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1314 microversion: 2.1 time: 0.170631 May 26 13:59:14.881822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 179/403] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:14 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:15.406731 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-68a124d5-ccbf-4454-a14b-cd92dcc92f62 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:15.407390 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-68a124d5-ccbf-4454-a14b-cd92dcc92f62 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:15.413369 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-68a124d5-ccbf-4454-a14b-cd92dcc92f62 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:15.413821 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-68a124d5-ccbf-4454-a14b-cd92dcc92f62 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:15.414575 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-68a124d5-ccbf-4454-a14b-cd92dcc92f62 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:15.415011 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-68a124d5-ccbf-4454-a14b-cd92dcc92f62 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:15.474081 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-68a124d5-ccbf-4454-a14b-cd92dcc92f62 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:15.481446 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-68a124d5-ccbf-4454-a14b-cd92dcc92f62 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1250 microversion: 2.1 time: 0.079006 May 26 13:59:15.482010 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 225/404] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:15 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1250 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:59:15.898786 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b611efbf-92f6-421e-ab7a-4d4a8cd704ce tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:15.899777 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b611efbf-92f6-421e-ab7a-4d4a8cd704ce tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:15.906353 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b611efbf-92f6-421e-ab7a-4d4a8cd704ce tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:15.906835 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b611efbf-92f6-421e-ab7a-4d4a8cd704ce tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:15.907608 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b611efbf-92f6-421e-ab7a-4d4a8cd704ce tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:15.908061 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b611efbf-92f6-421e-ab7a-4d4a8cd704ce tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:16.050929 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b611efbf-92f6-421e-ab7a-4d4a8cd704ce tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:16.058499 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b611efbf-92f6-421e-ab7a-4d4a8cd704ce tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1314 microversion: 2.1 time: 0.163489 May 26 13:59:16.059325 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 180/405] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:15 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:16.497996 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6440f8b4-1bba-4c23-abb2-06e9d6d0af4e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:16.498609 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6440f8b4-1bba-4c23-abb2-06e9d6d0af4e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:16.505294 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6440f8b4-1bba-4c23-abb2-06e9d6d0af4e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:16.505742 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6440f8b4-1bba-4c23-abb2-06e9d6d0af4e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:16.506579 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6440f8b4-1bba-4c23-abb2-06e9d6d0af4e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:16.507018 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6440f8b4-1bba-4c23-abb2-06e9d6d0af4e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:16.566040 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6440f8b4-1bba-4c23-abb2-06e9d6d0af4e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:16.573469 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6440f8b4-1bba-4c23-abb2-06e9d6d0af4e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1250 microversion: 2.1 time: 0.079365 May 26 13:59:16.582976 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 226/406] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:16 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1250 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:17.078327 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-864a8557-b018-4881-8ba3-2e5be8ede3f5 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:17.078932 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-864a8557-b018-4881-8ba3-2e5be8ede3f5 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:17.085352 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-864a8557-b018-4881-8ba3-2e5be8ede3f5 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:17.085801 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-864a8557-b018-4881-8ba3-2e5be8ede3f5 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:17.086559 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-864a8557-b018-4881-8ba3-2e5be8ede3f5 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:17.086993 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-864a8557-b018-4881-8ba3-2e5be8ede3f5 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:17.210503 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-864a8557-b018-4881-8ba3-2e5be8ede3f5 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:17.218497 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-864a8557-b018-4881-8ba3-2e5be8ede3f5 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1314 microversion: 2.1 time: 0.144510 May 26 13:59:17.219063 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 181/407] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:17 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:17.590315 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2358a0d5-b997-4732-ac59-5219755d17cc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:17.590912 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2358a0d5-b997-4732-ac59-5219755d17cc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:17.596918 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2358a0d5-b997-4732-ac59-5219755d17cc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:17.597398 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2358a0d5-b997-4732-ac59-5219755d17cc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:17.598181 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2358a0d5-b997-4732-ac59-5219755d17cc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:17.598613 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2358a0d5-b997-4732-ac59-5219755d17cc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:17.657072 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2358a0d5-b997-4732-ac59-5219755d17cc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:17.664504 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2358a0d5-b997-4732-ac59-5219755d17cc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1250 microversion: 2.1 time: 0.078054 May 26 13:59:17.665062 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 227/408] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:17 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1250 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:59:18.235841 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0c977c15-29fa-43f6-84ff-03f425e3e0f4 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:18.236418 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0c977c15-29fa-43f6-84ff-03f425e3e0f4 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:18.243076 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0c977c15-29fa-43f6-84ff-03f425e3e0f4 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:18.243770 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0c977c15-29fa-43f6-84ff-03f425e3e0f4 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:18.244538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0c977c15-29fa-43f6-84ff-03f425e3e0f4 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:18.244976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0c977c15-29fa-43f6-84ff-03f425e3e0f4 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:18.372503 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0c977c15-29fa-43f6-84ff-03f425e3e0f4 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:18.379831 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0c977c15-29fa-43f6-84ff-03f425e3e0f4 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1314 microversion: 2.1 time: 0.147857 May 26 13:59:18.380405 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 182/409] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:18 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:18.680574 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b2e6ff39-381a-4c8e-9172-6d57be73f6ff tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:18.681216 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b2e6ff39-381a-4c8e-9172-6d57be73f6ff tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:18.687301 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b2e6ff39-381a-4c8e-9172-6d57be73f6ff tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:18.687745 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b2e6ff39-381a-4c8e-9172-6d57be73f6ff tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:18.688504 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b2e6ff39-381a-4c8e-9172-6d57be73f6ff tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:18.688938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b2e6ff39-381a-4c8e-9172-6d57be73f6ff tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:18.748322 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b2e6ff39-381a-4c8e-9172-6d57be73f6ff tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:18.755833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b2e6ff39-381a-4c8e-9172-6d57be73f6ff tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1250 microversion: 2.1 time: 0.079081 May 26 13:59:18.756390 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 228/410] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:18 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1250 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:19.396354 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-05c39bcf-1b4d-49a6-bf9f-a51cb9a2db79 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:19.396955 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-05c39bcf-1b4d-49a6-bf9f-a51cb9a2db79 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:19.403933 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05c39bcf-1b4d-49a6-bf9f-a51cb9a2db79 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:19.404378 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05c39bcf-1b4d-49a6-bf9f-a51cb9a2db79 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:19.405133 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05c39bcf-1b4d-49a6-bf9f-a51cb9a2db79 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:19.405654 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05c39bcf-1b4d-49a6-bf9f-a51cb9a2db79 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:19.548678 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-05c39bcf-1b4d-49a6-bf9f-a51cb9a2db79 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:19.556122 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-05c39bcf-1b4d-49a6-bf9f-a51cb9a2db79 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1314 microversion: 2.1 time: 0.163536 May 26 13:59:19.556695 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 183/411] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:19 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:19.773060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fa0c9365-e492-4b1d-9398-a647c6df3269 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:19.773700 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fa0c9365-e492-4b1d-9398-a647c6df3269 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:19.780866 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fa0c9365-e492-4b1d-9398-a647c6df3269 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:19.781346 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fa0c9365-e492-4b1d-9398-a647c6df3269 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:19.782112 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fa0c9365-e492-4b1d-9398-a647c6df3269 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:19.782550 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fa0c9365-e492-4b1d-9398-a647c6df3269 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:19.843655 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fa0c9365-e492-4b1d-9398-a647c6df3269 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:19.851354 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fa0c9365-e492-4b1d-9398-a647c6df3269 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1250 microversion: 2.1 time: 0.082170 May 26 13:59:19.852412 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 229/412] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:19 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1250 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:20.573460 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a2b83316-2be4-4c2e-aa4f-bf0117443709 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:20.574631 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a2b83316-2be4-4c2e-aa4f-bf0117443709 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:20.581098 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a2b83316-2be4-4c2e-aa4f-bf0117443709 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:20.581573 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a2b83316-2be4-4c2e-aa4f-bf0117443709 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:20.582322 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a2b83316-2be4-4c2e-aa4f-bf0117443709 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:20.582750 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a2b83316-2be4-4c2e-aa4f-bf0117443709 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:20.706992 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a2b83316-2be4-4c2e-aa4f-bf0117443709 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:20.714737 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a2b83316-2be4-4c2e-aa4f-bf0117443709 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1314 microversion: 2.1 time: 0.145065 May 26 13:59:20.715289 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 184/413] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:20 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:20.867587 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-516daf2d-568c-41e0-88b0-1eb8248938af tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:20.868190 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-516daf2d-568c-41e0-88b0-1eb8248938af tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:20.874737 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-516daf2d-568c-41e0-88b0-1eb8248938af tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:20.875173 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-516daf2d-568c-41e0-88b0-1eb8248938af tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:20.875923 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-516daf2d-568c-41e0-88b0-1eb8248938af tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:20.876349 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-516daf2d-568c-41e0-88b0-1eb8248938af tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:20.935675 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-516daf2d-568c-41e0-88b0-1eb8248938af tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:20.942999 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-516daf2d-568c-41e0-88b0-1eb8248938af tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1250 microversion: 2.1 time: 0.079193 May 26 13:59:20.943550 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 230/414] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:20 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1250 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:21.731787 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a5b50718-0c38-401d-af85-62aad67cf924 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:21.732410 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a5b50718-0c38-401d-af85-62aad67cf924 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:21.734376 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=4 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:21.735186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=16 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:21.741932 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a5b50718-0c38-401d-af85-62aad67cf924 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:21.742359 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a5b50718-0c38-401d-af85-62aad67cf924 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:21.743135 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a5b50718-0c38-401d-af85-62aad67cf924 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:21.743772 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a5b50718-0c38-401d-af85-62aad67cf924 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:21.881849 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a5b50718-0c38-401d-af85-62aad67cf924 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:21.890151 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a5b50718-0c38-401d-af85-62aad67cf924 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1314 microversion: 2.1 time: 0.162481 May 26 13:59:21.890878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 185/415] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:21 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:21.959308 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d5e5b22d-d838-4a3f-b293-a29ee0734cc1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:21.959913 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d5e5b22d-d838-4a3f-b293-a29ee0734cc1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:21.961755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=4 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:21.967851 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d5e5b22d-d838-4a3f-b293-a29ee0734cc1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:21.968216 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d5e5b22d-d838-4a3f-b293-a29ee0734cc1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:21.969129 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d5e5b22d-d838-4a3f-b293-a29ee0734cc1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:21.969414 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d5e5b22d-d838-4a3f-b293-a29ee0734cc1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:22.033927 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d5e5b22d-d838-4a3f-b293-a29ee0734cc1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:22.041484 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d5e5b22d-d838-4a3f-b293-a29ee0734cc1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1242 microversion: 2.1 time: 0.085836 May 26 13:59:22.042051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 231/416] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:21 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:22.419973 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-7e7a622c-4c82-4bd0-b9c8-1861b829b83d req-bc6adbd3-27e8-42f1-8d46-6d0d929d616e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1645ce10-e28e-4a91-bc47-8ebe6a8acd0e", "name": "network-vif-plugged", "status": "completed", "tag": "fefc5ff7-7f07-4b4c-9a1f-242c2bae275e"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:59:22.429598 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-7e7a622c-4c82-4bd0-b9c8-1861b829b83d req-bc6adbd3-27e8-42f1-8d46-6d0d929d616e service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:22.430507 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-7e7a622c-4c82-4bd0-b9c8-1861b829b83d req-bc6adbd3-27e8-42f1-8d46-6d0d929d616e service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:22.442519 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-7e7a622c-4c82-4bd0-b9c8-1861b829b83d req-bc6adbd3-27e8-42f1-8d46-6d0d929d616e service nova] Creating event network-vif-plugged:fefc5ff7-7f07-4b4c-9a1f-242c2bae275e for instance 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e on hv-cinder-84213 May 26 13:59:22.447727 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-7e7a622c-4c82-4bd0-b9c8-1861b829b83d req-bc6adbd3-27e8-42f1-8d46-6d0d929d616e service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032072 May 26 13:59:22.448326 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 186/417] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 13:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:59:22.908804 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7523c7e5-6081-46c2-b535-b63f8080feca tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:22.909469 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7523c7e5-6081-46c2-b535-b63f8080feca tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:22.912605 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=50 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:22.917834 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7523c7e5-6081-46c2-b535-b63f8080feca tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:22.918294 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7523c7e5-6081-46c2-b535-b63f8080feca tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:22.919072 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7523c7e5-6081-46c2-b535-b63f8080feca tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:22.919533 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7523c7e5-6081-46c2-b535-b63f8080feca tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:23.060610 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b486d539-3f86-4cf7-aabf-067e6044f661 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:23.061336 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b486d539-3f86-4cf7-aabf-067e6044f661 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:23.068517 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b486d539-3f86-4cf7-aabf-067e6044f661 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:23.068973 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b486d539-3f86-4cf7-aabf-067e6044f661 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:23.069984 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b486d539-3f86-4cf7-aabf-067e6044f661 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:23.071537 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b486d539-3f86-4cf7-aabf-067e6044f661 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:23.090245 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:23.208853 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b486d539-3f86-4cf7-aabf-067e6044f661 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:23.217328 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b486d539-3f86-4cf7-aabf-067e6044f661 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1304 microversion: 2.1 time: 0.161956 May 26 13:59:23.218014 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 187/418] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:23 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1304 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:59:23.263945 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7523c7e5-6081-46c2-b535-b63f8080feca tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:23.271357 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7523c7e5-6081-46c2-b535-b63f8080feca tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1314 microversion: 2.1 time: 0.366761 May 26 13:59:23.271927 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 232/419] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:22 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:24.236193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-aa758642-efc5-4ef9-ade5-5aed0cd476c9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:24.237599 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-aa758642-efc5-4ef9-ade5-5aed0cd476c9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:24.247594 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aa758642-efc5-4ef9-ade5-5aed0cd476c9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:24.248048 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aa758642-efc5-4ef9-ade5-5aed0cd476c9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:24.248815 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aa758642-efc5-4ef9-ade5-5aed0cd476c9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:24.249446 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aa758642-efc5-4ef9-ade5-5aed0cd476c9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:24.288262 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-612b1847-6bde-404f-a049-e11bf7815378 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:24.289748 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-612b1847-6bde-404f-a049-e11bf7815378 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:24.296668 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-612b1847-6bde-404f-a049-e11bf7815378 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:24.297339 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-612b1847-6bde-404f-a049-e11bf7815378 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:24.298440 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-612b1847-6bde-404f-a049-e11bf7815378 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:24.299021 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-612b1847-6bde-404f-a049-e11bf7815378 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:24.329824 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-aa758642-efc5-4ef9-ade5-5aed0cd476c9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:24.338129 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-aa758642-efc5-4ef9-ade5-5aed0cd476c9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1304 microversion: 2.1 time: 0.106410 May 26 13:59:24.338736 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 188/420] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:24 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:24.530702 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-612b1847-6bde-404f-a049-e11bf7815378 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:24.539456 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-612b1847-6bde-404f-a049-e11bf7815378 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1314 microversion: 2.1 time: 0.255442 May 26 13:59:24.540090 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 233/421] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:24 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:59:25.361881 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e6b27dce-0bd3-410f-b2ae-b9656172ab40 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:25.362621 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e6b27dce-0bd3-410f-b2ae-b9656172ab40 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:25.372036 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e6b27dce-0bd3-410f-b2ae-b9656172ab40 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:25.373453 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e6b27dce-0bd3-410f-b2ae-b9656172ab40 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:25.374534 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e6b27dce-0bd3-410f-b2ae-b9656172ab40 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:25.375198 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e6b27dce-0bd3-410f-b2ae-b9656172ab40 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:25.493116 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e6b27dce-0bd3-410f-b2ae-b9656172ab40 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:25.505135 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e6b27dce-0bd3-410f-b2ae-b9656172ab40 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1304 microversion: 2.1 time: 0.152411 May 26 13:59:25.508272 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 189/422] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:25 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1304 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:25.559672 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f96537d0-afc1-49ff-ad6d-926ea66e280d tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:25.561015 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f96537d0-afc1-49ff-ad6d-926ea66e280d tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:25.584881 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f96537d0-afc1-49ff-ad6d-926ea66e280d tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:25.585791 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f96537d0-afc1-49ff-ad6d-926ea66e280d tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:25.587411 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f96537d0-afc1-49ff-ad6d-926ea66e280d tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:25.588174 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f96537d0-afc1-49ff-ad6d-926ea66e280d tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:25.927086 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f96537d0-afc1-49ff-ad6d-926ea66e280d tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:25.941114 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:25.947639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f96537d0-afc1-49ff-ad6d-926ea66e280d tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1314 microversion: 2.1 time: 0.392973 May 26 13:59:25.951063 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 234/423] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:25 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:26.526608 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ef332a81-7f74-41d8-ada6-498ef17f1361 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:26.527242 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ef332a81-7f74-41d8-ada6-498ef17f1361 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:26.536920 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:26.542834 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ef332a81-7f74-41d8-ada6-498ef17f1361 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:26.544075 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ef332a81-7f74-41d8-ada6-498ef17f1361 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:26.563911 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ef332a81-7f74-41d8-ada6-498ef17f1361 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:26.572040 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ef332a81-7f74-41d8-ada6-498ef17f1361 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:26.969125 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7dccdd18-635b-4a08-8731-b408053d9591 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:26.969806 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7dccdd18-635b-4a08-8731-b408053d9591 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:26.988002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7dccdd18-635b-4a08-8731-b408053d9591 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:26.989653 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7dccdd18-635b-4a08-8731-b408053d9591 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:26.990494 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7dccdd18-635b-4a08-8731-b408053d9591 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:26.997032 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7dccdd18-635b-4a08-8731-b408053d9591 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:27.205402 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ef332a81-7f74-41d8-ada6-498ef17f1361 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:27.217757 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ef332a81-7f74-41d8-ada6-498ef17f1361 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1372 microversion: 2.1 time: 0.694450 May 26 13:59:27.229235 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 190/424] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:26 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1372 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:59:27.318880 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-7d794f33-2e80-4e6a-a133-929b1e954249 req-c251d81f-7770-46e3-97da-b2c367df1a79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa89e8ed-11d3-42d2-b030-5b7497694471", "tag": "325f8a3e-5419-43f8-a8e8-0067da401f65"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:59:27.341437 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-7d794f33-2e80-4e6a-a133-929b1e954249 req-c251d81f-7770-46e3-97da-b2c367df1a79 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:27.344235 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-7d794f33-2e80-4e6a-a133-929b1e954249 req-c251d81f-7770-46e3-97da-b2c367df1a79 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:27.385277 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-7d794f33-2e80-4e6a-a133-929b1e954249 req-c251d81f-7770-46e3-97da-b2c367df1a79 service nova] Creating event network-changed:325f8a3e-5419-43f8-a8e8-0067da401f65 for instance aa89e8ed-11d3-42d2-b030-5b7497694471 on hv-cinder-84213 May 26 13:59:27.400212 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-7d794f33-2e80-4e6a-a133-929b1e954249 req-c251d81f-7770-46e3-97da-b2c367df1a79 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092905 May 26 13:59:27.400849 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 191/425] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 13:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:59:27.576013 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7dccdd18-635b-4a08-8731-b408053d9591 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:27.597564 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7dccdd18-635b-4a08-8731-b408053d9591 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1497 microversion: 2.1 time: 0.627510 May 26 13:59:27.606435 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 235/426] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:26 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1497 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:28.239322 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e1878033-3e36-4e7c-8c92-23d25c19687b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:28.240860 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e1878033-3e36-4e7c-8c92-23d25c19687b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:28.255089 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e1878033-3e36-4e7c-8c92-23d25c19687b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:28.255943 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e1878033-3e36-4e7c-8c92-23d25c19687b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:28.257622 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e1878033-3e36-4e7c-8c92-23d25c19687b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:28.258445 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e1878033-3e36-4e7c-8c92-23d25c19687b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:28.349209 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5e0735dd-92b8-4b6f-8b91-cc1bcf1a4561 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:28.349903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5e0735dd-92b8-4b6f-8b91-cc1bcf1a4561 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:28.356926 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5e0735dd-92b8-4b6f-8b91-cc1bcf1a4561 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:28.357763 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5e0735dd-92b8-4b6f-8b91-cc1bcf1a4561 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:28.358831 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5e0735dd-92b8-4b6f-8b91-cc1bcf1a4561 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:28.359478 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5e0735dd-92b8-4b6f-8b91-cc1bcf1a4561 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:28.398725 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5e0735dd-92b8-4b6f-8b91-cc1bcf1a4561 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:59:28.439132 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e1878033-3e36-4e7c-8c92-23d25c19687b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:28.451748 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e1878033-3e36-4e7c-8c92-23d25c19687b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1372 microversion: 2.1 time: 0.218726 May 26 13:59:28.452511 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 192/427] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:28 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1372 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:28.596968 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5e0735dd-92b8-4b6f-8b91-cc1bcf1a4561 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "DELETE /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 204 len: 0 microversion: 2.1 time: 0.251720 May 26 13:59:28.597896 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 236/428] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 13:59:28 2022] DELETE /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 13:59:28.606479 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-602c68eb-7206-4501-965e-679243b0ad74 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:28.607393 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-602c68eb-7206-4501-965e-679243b0ad74 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:28.614109 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-602c68eb-7206-4501-965e-679243b0ad74 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:28.618615 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-602c68eb-7206-4501-965e-679243b0ad74 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:28.622523 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-602c68eb-7206-4501-965e-679243b0ad74 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:28.623225 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-602c68eb-7206-4501-965e-679243b0ad74 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:28.990234 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-602c68eb-7206-4501-965e-679243b0ad74 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:29.002987 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-602c68eb-7206-4501-965e-679243b0ad74 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1503 microversion: 2.1 time: 0.400923 May 26 13:59:29.004103 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 193/429] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:28 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1503 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:29.473668 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b2df889e-8b1b-4559-a6eb-1abc6bd415b1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:29.478007 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b2df889e-8b1b-4559-a6eb-1abc6bd415b1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:29.489032 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b2df889e-8b1b-4559-a6eb-1abc6bd415b1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:29.489785 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b2df889e-8b1b-4559-a6eb-1abc6bd415b1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:29.491959 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b2df889e-8b1b-4559-a6eb-1abc6bd415b1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:29.492742 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b2df889e-8b1b-4559-a6eb-1abc6bd415b1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:29.722912 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b2df889e-8b1b-4559-a6eb-1abc6bd415b1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:29.756267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b2df889e-8b1b-4559-a6eb-1abc6bd415b1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1372 microversion: 2.1 time: 0.278671 May 26 13:59:29.757636 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 237/430] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:29 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1372 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:30.023526 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e1b0be60-da4d-472a-93a3-e7b498f41b49 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:30.025290 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e1b0be60-da4d-472a-93a3-e7b498f41b49 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:30.038734 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e1b0be60-da4d-472a-93a3-e7b498f41b49 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:30.041312 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e1b0be60-da4d-472a-93a3-e7b498f41b49 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:30.043333 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e1b0be60-da4d-472a-93a3-e7b498f41b49 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:30.043883 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e1b0be60-da4d-472a-93a3-e7b498f41b49 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:30.286878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e1b0be60-da4d-472a-93a3-e7b498f41b49 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:30.298836 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e1b0be60-da4d-472a-93a3-e7b498f41b49 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1503 microversion: 2.1 time: 0.281702 May 26 13:59:30.299897 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 194/431] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:30 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1503 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:30.774234 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3c28b999-3325-4536-bfcd-9891373dba0d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:30.776073 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3c28b999-3325-4536-bfcd-9891373dba0d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:30.784672 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c28b999-3325-4536-bfcd-9891373dba0d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:30.785650 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c28b999-3325-4536-bfcd-9891373dba0d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:30.787291 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c28b999-3325-4536-bfcd-9891373dba0d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:30.788046 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c28b999-3325-4536-bfcd-9891373dba0d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:31.022541 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3c28b999-3325-4536-bfcd-9891373dba0d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:31.046489 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3c28b999-3325-4536-bfcd-9891373dba0d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1372 microversion: 2.1 time: 0.276509 May 26 13:59:31.047765 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 238/432] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:30 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1372 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:31.319426 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-64ea298b-df47-49d5-811c-ac338a055173 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:31.320149 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-64ea298b-df47-49d5-811c-ac338a055173 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:31.327696 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-64ea298b-df47-49d5-811c-ac338a055173 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:31.328565 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-64ea298b-df47-49d5-811c-ac338a055173 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:31.329464 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-64ea298b-df47-49d5-811c-ac338a055173 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:31.329985 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-64ea298b-df47-49d5-811c-ac338a055173 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:31.943476 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-64ea298b-df47-49d5-811c-ac338a055173 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:31.965266 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-64ea298b-df47-49d5-811c-ac338a055173 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1503 microversion: 2.1 time: 0.650145 May 26 13:59:31.966440 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 195/433] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:31 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1503 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:32.069628 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9a26fe6b-fd2e-4a5d-8405-5581216d4101 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:32.070995 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9a26fe6b-fd2e-4a5d-8405-5581216d4101 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:32.082730 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a26fe6b-fd2e-4a5d-8405-5581216d4101 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:32.083738 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a26fe6b-fd2e-4a5d-8405-5581216d4101 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:32.087459 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a26fe6b-fd2e-4a5d-8405-5581216d4101 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:32.088165 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a26fe6b-fd2e-4a5d-8405-5581216d4101 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:32.318946 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9a26fe6b-fd2e-4a5d-8405-5581216d4101 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:32.329960 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9a26fe6b-fd2e-4a5d-8405-5581216d4101 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1372 microversion: 2.1 time: 0.269469 May 26 13:59:32.331867 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 239/434] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:32 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1372 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:32.982353 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f692c2f9-2282-457d-97e2-668c55a97fd5 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:32.983103 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f692c2f9-2282-457d-97e2-668c55a97fd5 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:32.998238 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f692c2f9-2282-457d-97e2-668c55a97fd5 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:32.998690 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f692c2f9-2282-457d-97e2-668c55a97fd5 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:32.999664 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f692c2f9-2282-457d-97e2-668c55a97fd5 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:33.000257 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f692c2f9-2282-457d-97e2-668c55a97fd5 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:33.349218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6ce16e18-b442-492f-be7c-0505a9a7623c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:33.350543 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6ce16e18-b442-492f-be7c-0505a9a7623c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:33.357498 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6ce16e18-b442-492f-be7c-0505a9a7623c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:33.358197 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6ce16e18-b442-492f-be7c-0505a9a7623c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:33.359234 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6ce16e18-b442-492f-be7c-0505a9a7623c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:33.359954 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6ce16e18-b442-492f-be7c-0505a9a7623c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:33.676483 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f692c2f9-2282-457d-97e2-668c55a97fd5 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:33.699258 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f692c2f9-2282-457d-97e2-668c55a97fd5 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1503 microversion: 2.1 time: 0.720909 May 26 13:59:33.716725 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 196/435] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:32 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1503 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:34.130160 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6ce16e18-b442-492f-be7c-0505a9a7623c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:34.137893 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6ce16e18-b442-492f-be7c-0505a9a7623c tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1372 microversion: 2.1 time: 0.792420 May 26 13:59:34.138693 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 240/436] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:33 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1372 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:34.718487 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6bb94934-5074-4338-a1e1-e51f0acd9dde tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:34.719698 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6bb94934-5074-4338-a1e1-e51f0acd9dde tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:34.726692 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6bb94934-5074-4338-a1e1-e51f0acd9dde tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:34.727410 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6bb94934-5074-4338-a1e1-e51f0acd9dde tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:34.728346 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6bb94934-5074-4338-a1e1-e51f0acd9dde tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:34.728937 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6bb94934-5074-4338-a1e1-e51f0acd9dde tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:35.168883 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d42002de-8a46-44c5-9cee-15647ad7a4e1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:35.170306 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d42002de-8a46-44c5-9cee-15647ad7a4e1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:35.189934 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d42002de-8a46-44c5-9cee-15647ad7a4e1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:35.199297 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d42002de-8a46-44c5-9cee-15647ad7a4e1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:35.200319 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d42002de-8a46-44c5-9cee-15647ad7a4e1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:35.200930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d42002de-8a46-44c5-9cee-15647ad7a4e1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:35.796364 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6bb94934-5074-4338-a1e1-e51f0acd9dde tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:35.810750 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6bb94934-5074-4338-a1e1-e51f0acd9dde tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 200 len: 1503 microversion: 2.1 time: 1.097271 May 26 13:59:35.824219 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 197/437] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:34 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 1503 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:36.053837 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-f7be4b7a-a409-433c-9b8f-7f22d33f58d1 req-b2ddd0f9-c3ef-4a09-a5d9-802f2a1cd3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1645ce10-e28e-4a91-bc47-8ebe6a8acd0e", "name": "network-vif-deleted", "tag": "fefc5ff7-7f07-4b4c-9a1f-242c2bae275e"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:59:36.077887 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-f7be4b7a-a409-433c-9b8f-7f22d33f58d1 req-b2ddd0f9-c3ef-4a09-a5d9-802f2a1cd3e6 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:36.079350 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-f7be4b7a-a409-433c-9b8f-7f22d33f58d1 req-b2ddd0f9-c3ef-4a09-a5d9-802f2a1cd3e6 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:36.095305 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-f7be4b7a-a409-433c-9b8f-7f22d33f58d1 req-b2ddd0f9-c3ef-4a09-a5d9-802f2a1cd3e6 service nova] Creating event network-vif-deleted:fefc5ff7-7f07-4b4c-9a1f-242c2bae275e for instance 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e on hv-cinder-84213 May 26 13:59:36.105372 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-f7be4b7a-a409-433c-9b8f-7f22d33f58d1 req-b2ddd0f9-c3ef-4a09-a5d9-802f2a1cd3e6 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056012 May 26 13:59:36.106833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 198/438] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 13:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:59:36.135919 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d42002de-8a46-44c5-9cee-15647ad7a4e1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:36.152308 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d42002de-8a46-44c5-9cee-15647ad7a4e1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1372 microversion: 2.1 time: 0.982790 May 26 13:59:36.153276 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 241/439] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:35 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1372 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:59:36.842990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9cd23c3e-c2cb-4063-9a71-cb5ed59fdde8 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:36.844111 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9cd23c3e-c2cb-4063-9a71-cb5ed59fdde8 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:36.876558 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9cd23c3e-c2cb-4063-9a71-cb5ed59fdde8 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:36.877981 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9cd23c3e-c2cb-4063-9a71-cb5ed59fdde8 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:36.879057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9cd23c3e-c2cb-4063-9a71-cb5ed59fdde8 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:36.879671 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9cd23c3e-c2cb-4063-9a71-cb5ed59fdde8 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:36.923347 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-9cd23c3e-c2cb-4063-9a71-cb5ed59fdde8 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] HTTP exception thrown: Instance 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e could not be found. May 26 13:59:36.927275 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9cd23c3e-c2cb-4063-9a71-cb5ed59fdde8 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Request method failure captured: May 26 13:59:36.927275 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e HTTP/1.1 May 26 13:59:36.927275 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 13:59:36.927275 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 13:59:36.927275 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 13:59:36.927275 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 13:59:36.927275 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 13:59:36.927275 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 13:59:36.927275 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 13:59:36.927275 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 13:59:36.927275 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4eip47b0amme2b6ONx5yE67oMBefO_EAKVNpUhhpsGog2gr8TZXNa7lzj022TyxLyDZUtWuRlc8Li8Iku6UUfh4RLzBf98h5yXacVNrMea6oDaj-8EPHw2kJWTyUOgkMtGPeF4K3MYsU7z0xJQ1n3QwvFMaQ6IHC2GIQIB-ZYUG9rI May 26 13:59:36.927275 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 13:59:36.927275 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 13:59:36.927275 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 13:59:36.927275 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 13:59:36.927275 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 13:59:36.927275 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 13:59:36.927275 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: 12082647641d4ece974c66384e3bf169 May 26 13:59:36.927275 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesActionsTest-716628881 May 26 13:59:36.927275 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 13:59:36.927275 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 13:59:36.928889 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/12082647641d4ece974c66384e3bf169"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/12082647641d4ece974c66384e3bf169"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/12082647641d4ece974c66384e3bf169"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_12082647641d4ece974c66384e3bf169", "adminURL": "http://10.222.0.91:8080"}]}] May 26 13:59:36.928889 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesActionsTest-716628881 May 26 13:59:36.928889 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 12082647641d4ece974c66384e3bf169 May 26 13:59:36.928889 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesActionsTest-716628881 May 26 13:59:36.928889 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesActionsTest-716628881-project May 26 13:59:36.928889 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 13:59:36.928889 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 13:59:36.928889 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: 2eb759cf823b45d2aa35fdcacc7ac3e8 May 26 13:59:36.928889 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesActionsTest-716628881-project May 26 13:59:36.928889 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: > May 26 13:59:36.928889 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Instance 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e could not be found. May 26 13:59:36.928889 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'id': '1645ce10-e28e-4a91-bc47-8ebe6a8acd0e'} May 26 13:59:36.929861 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:59:36.929861 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:59:36.929861 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:59:36.929861 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:59:36.929861 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:59:36.929861 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:59:36.929861 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:59:36.929861 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:59:36.929861 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:59:36.929861 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:59:36.929861 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e could not be found. May 26 13:59:36.929861 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:59:36.929861 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:59:36.929861 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:59:36.929861 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:59:36.929861 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:59:36.929861 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:59:36.929861 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:59:36.929861 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:59:36.929861 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:59:36.931282 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:59:36.931282 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:59:36.931282 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:59:36.931282 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:59:36.931282 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:59:36.931282 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:59:36.931282 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:59:36.931282 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e could not be found. May 26 13:59:36.931282 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:59:36.931282 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:59:36.931282 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:59:36.931282 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:59:36.931282 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:59:36.931282 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:59:36.931282 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:59:36.931282 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:59:36.931282 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e could not be found. May 26 13:59:36.931282 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 13:59:36.933107 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9cd23c3e-c2cb-4063-9a71-cb5ed59fdde8 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Returning 404 to user: Instance 1645ce10-e28e-4a91-bc47-8ebe6a8acd0e could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:59:36.933107 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9cd23c3e-c2cb-4063-9a71-cb5ed59fdde8 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e" status: 404 len: 111 microversion: 2.1 time: 0.097871 May 26 13:59:36.933824 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 199/440] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:36 2022] GET /compute/v2.1/servers/1645ce10-e28e-4a91-bc47-8ebe6a8acd0e => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:59:37.171802 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-87f1244c-765a-4bb1-9697-d24684ef53e4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:37.172421 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-87f1244c-765a-4bb1-9697-d24684ef53e4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:37.188981 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-36191d7a-4d92-42fa-a85d-7b3987e928dc tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1966392335", "imageRef": "bcaacfae-fe2c-455f-a6e1-b08361c6fa8c", "flavorRef": "452", "networks": [{"uuid": "3c753870-7084-433e-b67c-0097f665e28b"}]}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:59:37.197526 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-87f1244c-765a-4bb1-9697-d24684ef53e4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:37.197983 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-87f1244c-765a-4bb1-9697-d24684ef53e4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:37.199393 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-87f1244c-765a-4bb1-9697-d24684ef53e4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:37.199839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-87f1244c-765a-4bb1-9697-d24684ef53e4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:37.331285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-36191d7a-4d92-42fa-a85d-7b3987e928dc tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] validate_networks() for [('3c753870-7084-433e-b67c-0097f665e28b', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:59:37.708360 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-87f1244c-765a-4bb1-9697-d24684ef53e4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:37.721429 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-87f1244c-765a-4bb1-9697-d24684ef53e4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1372 microversion: 2.1 time: 0.555294 May 26 13:59:37.722029 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 242/441] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:37 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1372 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:38.447225 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:59:38.447796 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Thu May 26 13:59:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:59:38.740904 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b47c9b2e-fc6f-4a66-8b18-c89b26e2a4bc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:38.741649 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b47c9b2e-fc6f-4a66-8b18-c89b26e2a4bc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:38.756079 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b47c9b2e-fc6f-4a66-8b18-c89b26e2a4bc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:38.756788 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b47c9b2e-fc6f-4a66-8b18-c89b26e2a4bc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:38.757751 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b47c9b2e-fc6f-4a66-8b18-c89b26e2a4bc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:38.758346 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b47c9b2e-fc6f-4a66-8b18-c89b26e2a4bc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:39.138422 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-36191d7a-4d92-42fa-a85d-7b3987e928dc tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:59:39.139599 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-36191d7a-4d92-42fa-a85d-7b3987e928dc tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:59:39.140248 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-36191d7a-4d92-42fa-a85d-7b3987e928dc tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:59:39.143156 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-36191d7a-4d92-42fa-a85d-7b3987e928dc tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:59:39.143766 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-36191d7a-4d92-42fa-a85d-7b3987e928dc tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:59:39.164222 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36191d7a-4d92-42fa-a85d-7b3987e928dc tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:39.164960 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36191d7a-4d92-42fa-a85d-7b3987e928dc tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:39.165795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36191d7a-4d92-42fa-a85d-7b3987e928dc tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:39.166235 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36191d7a-4d92-42fa-a85d-7b3987e928dc tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:39.213208 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-36191d7a-4d92-42fa-a85d-7b3987e928dc tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Getting quotas for project 12082647641d4ece974c66384e3bf169. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:59:39.221532 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-36191d7a-4d92-42fa-a85d-7b3987e928dc tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Getting quotas for user 2eb759cf823b45d2aa35fdcacc7ac3e8 and project 12082647641d4ece974c66384e3bf169. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:59:39.234888 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-36191d7a-4d92-42fa-a85d-7b3987e928dc tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:59:39.238111 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-36191d7a-4d92-42fa-a85d-7b3987e928dc tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bcaacfae-fe2c-455f-a6e1-b08361c6fa8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:59:39.316737 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-36191d7a-4d92-42fa-a85d-7b3987e928dc tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.132163 May 26 13:59:39.325342 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 200/442] 10.222.0.91 () {60 vars in 1146 bytes} [Thu May 26 13:59:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:59:39.503084 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b47c9b2e-fc6f-4a66-8b18-c89b26e2a4bc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:39.516443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b47c9b2e-fc6f-4a66-8b18-c89b26e2a4bc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1372 microversion: 2.1 time: 0.781017 May 26 13:59:39.517025 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 243/443] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:38 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1372 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:59:39.536941 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-3ab0f55a-d245-44aa-a2af-3b69d29254e4 req-bf137bbb-c607-4385-b9ca-38f3cf812e1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa89e8ed-11d3-42d2-b030-5b7497694471", "name": "network-vif-plugged", "status": "completed", "tag": "325f8a3e-5419-43f8-a8e8-0067da401f65"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:59:39.584042 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-3ab0f55a-d245-44aa-a2af-3b69d29254e4 req-bf137bbb-c607-4385-b9ca-38f3cf812e1f service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:39.584489 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-3ab0f55a-d245-44aa-a2af-3b69d29254e4 req-bf137bbb-c607-4385-b9ca-38f3cf812e1f service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:39.620646 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-3ab0f55a-d245-44aa-a2af-3b69d29254e4 req-bf137bbb-c607-4385-b9ca-38f3cf812e1f service nova] Creating event network-vif-plugged:325f8a3e-5419-43f8-a8e8-0067da401f65 for instance aa89e8ed-11d3-42d2-b030-5b7497694471 on hv-cinder-84213 May 26 13:59:39.652786 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-3ab0f55a-d245-44aa-a2af-3b69d29254e4 req-bf137bbb-c607-4385-b9ca-38f3cf812e1f service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134401 May 26 13:59:39.660114 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 244/444] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 13:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:59:39.683161 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-74931c45-0494-4492-8486-2bea5c5dcb90 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:39.684073 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-74931c45-0494-4492-8486-2bea5c5dcb90 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:39.975556 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-74931c45-0494-4492-8486-2bea5c5dcb90 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:39.988172 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-74931c45-0494-4492-8486-2bea5c5dcb90 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649" status: 200 len: 1214 microversion: 2.1 time: 0.326734 May 26 13:59:39.988774 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 245/445] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:39 2022] GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 => generated 1214 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:40.086762 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d3205cf3-9806-4dbc-b167-33bf1f84445d tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Action: 'create', calling method: .version_select at 0x7f25a4b37790>, body: {"keypair": {"name": "tempest-TestShelveInstance-1017305677", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVss3EOpmx+fi+ytrF7y0gW69ebYp5JJftN+MwxSSy2kzrg+co7TQlAlmSI9M3dKW9WWdDgUy2ad46h1H8WSxndSDnXFBCX7z3SX4kLAW34jqQrEFG1oUj7/9rd9AJ5CA=="}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:59:40.135632 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-d3205cf3-9806-4dbc-b167-33bf1f84445d tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Getting quotas for project 4d13c9a0ad1146158525c3398ff4de2a. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:59:40.143871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-d3205cf3-9806-4dbc-b167-33bf1f84445d tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Getting quotas for user ecacca157e3a43b79659f78e4beb0c5e and project 4d13c9a0ad1146158525c3398ff4de2a. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:59:40.234168 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d3205cf3-9806-4dbc-b167-33bf1f84445d tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.907562 May 26 13:59:40.234776 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 201/446] 10.222.0.91 () {60 vars in 1158 bytes} [Thu May 26 13:59:39 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:59:40.533979 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4e1f316d-dc75-4469-b5d5-71488d364f99 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:40.534621 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4e1f316d-dc75-4469-b5d5-71488d364f99 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:40.549738 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4e1f316d-dc75-4469-b5d5-71488d364f99 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:40.550183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4e1f316d-dc75-4469-b5d5-71488d364f99 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:40.552738 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4e1f316d-dc75-4469-b5d5-71488d364f99 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:40.553252 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4e1f316d-dc75-4469-b5d5-71488d364f99 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:41.004886 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-018b3421-119a-4500-985d-8283d0c1e356 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:41.005528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-018b3421-119a-4500-985d-8283d0c1e356 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:41.016478 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-018b3421-119a-4500-985d-8283d0c1e356 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:41.017188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-018b3421-119a-4500-985d-8283d0c1e356 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:41.018143 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-018b3421-119a-4500-985d-8283d0c1e356 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:41.018731 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-018b3421-119a-4500-985d-8283d0c1e356 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:41.077366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4e1f316d-dc75-4469-b5d5-71488d364f99 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:41.095669 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4e1f316d-dc75-4469-b5d5-71488d364f99 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1372 microversion: 2.1 time: 0.563465 May 26 13:59:41.097140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 246/447] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:40 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1372 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:41.315215 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-018b3421-119a-4500-985d-8283d0c1e356 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:41.334231 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-018b3421-119a-4500-985d-8283d0c1e356 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649" status: 200 len: 1266 microversion: 2.1 time: 0.331915 May 26 13:59:41.336778 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 202/448] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:40 2022] GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 => generated 1266 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:42.114413 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-10cdb550-0786-40af-a2ca-89d0db7f5f88 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:42.115081 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-10cdb550-0786-40af-a2ca-89d0db7f5f88 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:42.121938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-10cdb550-0786-40af-a2ca-89d0db7f5f88 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:42.123291 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-10cdb550-0786-40af-a2ca-89d0db7f5f88 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:42.127111 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-10cdb550-0786-40af-a2ca-89d0db7f5f88 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:42.127617 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-10cdb550-0786-40af-a2ca-89d0db7f5f88 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:42.356886 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f4df4bc7-8153-4e13-8bc7-2d4049fa34e4 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:42.358082 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f4df4bc7-8153-4e13-8bc7-2d4049fa34e4 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:42.383668 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4df4bc7-8153-4e13-8bc7-2d4049fa34e4 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:42.384167 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4df4bc7-8153-4e13-8bc7-2d4049fa34e4 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:42.385055 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4df4bc7-8153-4e13-8bc7-2d4049fa34e4 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:42.386864 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4df4bc7-8153-4e13-8bc7-2d4049fa34e4 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:42.592535 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f4df4bc7-8153-4e13-8bc7-2d4049fa34e4 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:42.607002 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f4df4bc7-8153-4e13-8bc7-2d4049fa34e4 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649" status: 200 len: 1272 microversion: 2.1 time: 0.255459 May 26 13:59:42.608414 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 203/449] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:42 2022] GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 => generated 1272 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:59:42.808658 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-10cdb550-0786-40af-a2ca-89d0db7f5f88 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:42.818324 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-10cdb550-0786-40af-a2ca-89d0db7f5f88 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1372 microversion: 2.1 time: 0.708189 May 26 13:59:42.828112 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 247/450] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:42 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1372 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:43.626214 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-078c5773-c6ac-49f1-9b5b-266e0e8e477c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:43.627516 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-078c5773-c6ac-49f1-9b5b-266e0e8e477c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:43.637236 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-078c5773-c6ac-49f1-9b5b-266e0e8e477c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:43.643776 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-078c5773-c6ac-49f1-9b5b-266e0e8e477c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:43.645473 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-078c5773-c6ac-49f1-9b5b-266e0e8e477c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:43.647554 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-078c5773-c6ac-49f1-9b5b-266e0e8e477c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:43.836314 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3981be7d-f28d-4d09-a435-0606c688c81d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:43.837284 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3981be7d-f28d-4d09-a435-0606c688c81d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:43.853634 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3981be7d-f28d-4d09-a435-0606c688c81d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:43.854646 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3981be7d-f28d-4d09-a435-0606c688c81d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:43.855653 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3981be7d-f28d-4d09-a435-0606c688c81d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:43.858034 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3981be7d-f28d-4d09-a435-0606c688c81d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:44.582859 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-078c5773-c6ac-49f1-9b5b-266e0e8e477c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:44.594409 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-078c5773-c6ac-49f1-9b5b-266e0e8e477c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649" status: 200 len: 1314 microversion: 2.1 time: 0.972337 May 26 13:59:44.596206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 204/451] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:43 2022] GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 => generated 1314 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:44.702132 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3981be7d-f28d-4d09-a435-0606c688c81d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:44.712169 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3981be7d-f28d-4d09-a435-0606c688c81d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1564 microversion: 2.1 time: 0.880708 May 26 13:59:44.712755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 248/452] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:43 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1564 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:59:44.731033 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a6ed6ca0-f992-41d1-9bb0-6db72682c7ef tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:44.739252 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a6ed6ca0-f992-41d1-9bb0-6db72682c7ef tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:44.746076 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a6ed6ca0-f992-41d1-9bb0-6db72682c7ef tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:44.749258 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a6ed6ca0-f992-41d1-9bb0-6db72682c7ef tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:44.750325 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a6ed6ca0-f992-41d1-9bb0-6db72682c7ef tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:44.755549 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a6ed6ca0-f992-41d1-9bb0-6db72682c7ef tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:45.122915 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a6ed6ca0-f992-41d1-9bb0-6db72682c7ef tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.397021 May 26 13:59:45.128486 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 205/453] 10.222.0.91 () {58 vars in 1274 bytes} [Thu May 26 13:59:44 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471/os-interface => generated 284 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:59:45.613411 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f0b2006b-a962-4e7b-b1ad-270709d4f18d tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:45.614162 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f0b2006b-a962-4e7b-b1ad-270709d4f18d tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:45.625181 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f0b2006b-a962-4e7b-b1ad-270709d4f18d tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:45.625880 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f0b2006b-a962-4e7b-b1ad-270709d4f18d tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:45.629535 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f0b2006b-a962-4e7b-b1ad-270709d4f18d tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:45.630154 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f0b2006b-a962-4e7b-b1ad-270709d4f18d tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:46.249845 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f0b2006b-a962-4e7b-b1ad-270709d4f18d tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:46.262331 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f0b2006b-a962-4e7b-b1ad-270709d4f18d tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649" status: 200 len: 1314 microversion: 2.1 time: 0.652732 May 26 13:59:46.262932 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 249/454] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:45 2022] GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 => generated 1314 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:46.360371 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-26b7c616-65a3-4ce3-8fe8-2315d76d939a req-b7eb25df-fe59-4cdc-b3d4-46da1d55b536 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649", "tag": "41e6383a-25f2-45be-aa0c-cffb6e1f1143"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:59:46.380216 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-26b7c616-65a3-4ce3-8fe8-2315d76d939a req-b7eb25df-fe59-4cdc-b3d4-46da1d55b536 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:46.380866 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-26b7c616-65a3-4ce3-8fe8-2315d76d939a req-b7eb25df-fe59-4cdc-b3d4-46da1d55b536 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:46.421835 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-26b7c616-65a3-4ce3-8fe8-2315d76d939a req-b7eb25df-fe59-4cdc-b3d4-46da1d55b536 service nova] Creating event network-changed:41e6383a-25f2-45be-aa0c-cffb6e1f1143 for instance 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 on hv-cinder-84213 May 26 13:59:46.427704 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-26b7c616-65a3-4ce3-8fe8-2315d76d939a req-b7eb25df-fe59-4cdc-b3d4-46da1d55b536 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072282 May 26 13:59:46.431141 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 206/455] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 13:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:59:47.280143 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a2214215-51ba-48fc-b178-c5058e35a05c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:47.280819 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a2214215-51ba-48fc-b178-c5058e35a05c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:47.290226 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2214215-51ba-48fc-b178-c5058e35a05c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:47.300472 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2214215-51ba-48fc-b178-c5058e35a05c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:47.301791 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2214215-51ba-48fc-b178-c5058e35a05c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:47.302431 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2214215-51ba-48fc-b178-c5058e35a05c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:47.545761 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a2214215-51ba-48fc-b178-c5058e35a05c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:47.556663 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a2214215-51ba-48fc-b178-c5058e35a05c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649" status: 200 len: 1314 microversion: 2.1 time: 0.281008 May 26 13:59:47.564388 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 250/456] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:47 2022] GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:48.576272 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-61557d93-99cd-41e3-8760-8136d7dc6cfd tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:48.577126 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-61557d93-99cd-41e3-8760-8136d7dc6cfd tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:48.591173 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-61557d93-99cd-41e3-8760-8136d7dc6cfd tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:48.594581 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-61557d93-99cd-41e3-8760-8136d7dc6cfd tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:48.596140 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-61557d93-99cd-41e3-8760-8136d7dc6cfd tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:48.603466 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-61557d93-99cd-41e3-8760-8136d7dc6cfd tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:48.688105 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-5b3499a5-ac18-4986-810e-f81e4b8c34a6 req-219d18b0-e711-436f-98b9-9d359c9a8643 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa89e8ed-11d3-42d2-b030-5b7497694471", "tag": "325f8a3e-5419-43f8-a8e8-0067da401f65"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:59:48.705965 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-5b3499a5-ac18-4986-810e-f81e4b8c34a6 req-219d18b0-e711-436f-98b9-9d359c9a8643 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:48.706534 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-5b3499a5-ac18-4986-810e-f81e4b8c34a6 req-219d18b0-e711-436f-98b9-9d359c9a8643 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:48.727443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-5b3499a5-ac18-4986-810e-f81e4b8c34a6 req-219d18b0-e711-436f-98b9-9d359c9a8643 service nova] Creating event network-changed:325f8a3e-5419-43f8-a8e8-0067da401f65 for instance aa89e8ed-11d3-42d2-b030-5b7497694471 on hv-cinder-84213 May 26 13:59:48.742481 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-5b3499a5-ac18-4986-810e-f81e4b8c34a6 req-219d18b0-e711-436f-98b9-9d359c9a8643 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057964 May 26 13:59:48.748849 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 251/457] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 13:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:59:49.011354 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-61557d93-99cd-41e3-8760-8136d7dc6cfd tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:49.026992 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-61557d93-99cd-41e3-8760-8136d7dc6cfd tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649" status: 200 len: 1314 microversion: 2.1 time: 0.454382 May 26 13:59:49.027859 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 207/458] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:48 2022] GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:50.051776 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7353486c-8f47-4e45-889a-abe70026fdbd tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:50.052508 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7353486c-8f47-4e45-889a-abe70026fdbd tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:50.071117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:50.075990 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7353486c-8f47-4e45-889a-abe70026fdbd tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:50.077404 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7353486c-8f47-4e45-889a-abe70026fdbd tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:50.079831 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7353486c-8f47-4e45-889a-abe70026fdbd tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:50.082069 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7353486c-8f47-4e45-889a-abe70026fdbd tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:50.098300 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:50.412923 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7353486c-8f47-4e45-889a-abe70026fdbd tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:50.425332 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7353486c-8f47-4e45-889a-abe70026fdbd tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649" status: 200 len: 1314 microversion: 2.1 time: 0.381634 May 26 13:59:50.465486 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 252/459] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:50 2022] GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:51.446008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0d66ff74-8998-4142-b646-9916c092d0dc tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:51.446715 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0d66ff74-8998-4142-b646-9916c092d0dc tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:51.463162 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:51.464926 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=10 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:51.474349 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d66ff74-8998-4142-b646-9916c092d0dc tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:51.474702 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d66ff74-8998-4142-b646-9916c092d0dc tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:51.475519 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d66ff74-8998-4142-b646-9916c092d0dc tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:51.476440 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d66ff74-8998-4142-b646-9916c092d0dc tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:52.303394 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0d66ff74-8998-4142-b646-9916c092d0dc tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:52.319264 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:52.330758 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0d66ff74-8998-4142-b646-9916c092d0dc tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649" status: 200 len: 1314 microversion: 2.1 time: 0.891274 May 26 13:59:52.331976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 208/460] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:51 2022] GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 => generated 1314 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:53.348197 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-618354d2-d970-4704-988c-e0862feb5280 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:53.350689 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-618354d2-d970-4704-988c-e0862feb5280 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:53.361405 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:53.366262 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-618354d2-d970-4704-988c-e0862feb5280 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:53.375326 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-618354d2-d970-4704-988c-e0862feb5280 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:53.377722 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-618354d2-d970-4704-988c-e0862feb5280 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:53.382926 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-618354d2-d970-4704-988c-e0862feb5280 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:53.691521 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-618354d2-d970-4704-988c-e0862feb5280 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:53.700849 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-618354d2-d970-4704-988c-e0862feb5280 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649" status: 200 len: 1314 microversion: 2.1 time: 0.356800 May 26 13:59:53.701464 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 253/461] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:53 2022] GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:54.718518 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-45e98706-95a5-4ef2-86f2-454ec22f3f07 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:54.720406 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-45e98706-95a5-4ef2-86f2-454ec22f3f07 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:54.748593 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-45e98706-95a5-4ef2-86f2-454ec22f3f07 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:54.749055 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-45e98706-95a5-4ef2-86f2-454ec22f3f07 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:54.749870 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-45e98706-95a5-4ef2-86f2-454ec22f3f07 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:54.755727 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-45e98706-95a5-4ef2-86f2-454ec22f3f07 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:54.762981 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-bb77ed63-36eb-4345-b3c7-11b80d97d89a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:54.764216 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-bb77ed63-36eb-4345-b3c7-11b80d97d89a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:54.773921 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bb77ed63-36eb-4345-b3c7-11b80d97d89a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:54.777644 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bb77ed63-36eb-4345-b3c7-11b80d97d89a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:54.781572 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bb77ed63-36eb-4345-b3c7-11b80d97d89a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:54.793978 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bb77ed63-36eb-4345-b3c7-11b80d97d89a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:54.868464 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-bb77ed63-36eb-4345-b3c7-11b80d97d89a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2/ips" status: 200 len: 151 microversion: 2.1 time: 0.110255 May 26 13:59:54.887045 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 254/462] 10.222.0.91 () {58 vars in 1247 bytes} [Thu May 26 13:59:54 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2/ips => generated 151 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:59:55.255329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-45e98706-95a5-4ef2-86f2-454ec22f3f07 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:55.273001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-45e98706-95a5-4ef2-86f2-454ec22f3f07 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649" status: 200 len: 1314 microversion: 2.1 time: 0.557945 May 26 13:59:55.289226 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 209/463] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:54 2022] GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:55.521599 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5b9afd79-1397-44fe-ac95-b4685f2895e4 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Action: 'create', calling method: .version_select at 0x7f25a556a310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-886850747", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZ2tB5FfisdwI6UD0ZIKRG2ONmo99FtqAkU+gksbLIdqq9zQaUIbxL8RKDrZO0hIw8kW1Uc7NXcntCkvc1S90bWN0DEzVLRcYgx4rRIupq0nMv8mZiLuW14P93j+KsdIg=="}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:59:55.562433 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-5b9afd79-1397-44fe-ac95-b4685f2895e4 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Getting quotas for project ed15631acafd41528b96f2ed12c19e5b. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:59:55.566897 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-5b9afd79-1397-44fe-ac95-b4685f2895e4 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Getting quotas for user 5068f06b1a8e47b88ba3294169545aa3 and project ed15631acafd41528b96f2ed12c19e5b. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:59:55.658667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5b9afd79-1397-44fe-ac95-b4685f2895e4 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.517642 May 26 13:59:55.660019 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 255/464] 10.222.0.91 () {60 vars in 1158 bytes} [Thu May 26 13:59:55 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:59:56.292965 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6290ede8-441a-41d4-974b-47e2f1416c37 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:56.294441 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6290ede8-441a-41d4-974b-47e2f1416c37 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:56.302870 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6290ede8-441a-41d4-974b-47e2f1416c37 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:56.303323 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6290ede8-441a-41d4-974b-47e2f1416c37 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:56.304108 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6290ede8-441a-41d4-974b-47e2f1416c37 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:56.304550 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6290ede8-441a-41d4-974b-47e2f1416c37 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:56.533348 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6290ede8-441a-41d4-974b-47e2f1416c37 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:56.544288 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6290ede8-441a-41d4-974b-47e2f1416c37 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649" status: 200 len: 1314 microversion: 2.1 time: 0.257942 May 26 13:59:56.553500 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 210/465] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:56 2022] GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:56.672666 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1cf5a74b-fa9e-4294-8990-6700f7929b7e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12d5cd19-1034-4f44-a7a8-6c4c87007719"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:59:56.675429 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1cf5a74b-fa9e-4294-8990-6700f7929b7e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:56.684061 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1cf5a74b-fa9e-4294-8990-6700f7929b7e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:56.684994 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1cf5a74b-fa9e-4294-8990-6700f7929b7e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:56.686299 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1cf5a74b-fa9e-4294-8990-6700f7929b7e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:56.686933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1cf5a74b-fa9e-4294-8990-6700f7929b7e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:57.152374 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1cf5a74b-fa9e-4294-8990-6700f7929b7e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "POST /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.485121 May 26 13:59:57.158646 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 256/466] 10.222.0.91 () {60 vars in 1322 bytes} [Thu May 26 13:59:56 2022] POST /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2/os-volume_attachments => generated 194 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:59:57.560319 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6455abce-84eb-430f-8d79-213280ba9ce2 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:57.561400 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6455abce-84eb-430f-8d79-213280ba9ce2 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:57.571480 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:57.573685 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6455abce-84eb-430f-8d79-213280ba9ce2 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:57.574143 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6455abce-84eb-430f-8d79-213280ba9ce2 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:57.574942 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6455abce-84eb-430f-8d79-213280ba9ce2 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:57.575399 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6455abce-84eb-430f-8d79-213280ba9ce2 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:57.811623 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6455abce-84eb-430f-8d79-213280ba9ce2 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:57.822607 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6455abce-84eb-430f-8d79-213280ba9ce2 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649" status: 200 len: 1314 microversion: 2.1 time: 0.266448 May 26 13:59:57.823876 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 211/467] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:57 2022] GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:58.578231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-26c749da-c8c6-4116-8ce4-e4220714b3b4 req-5eb98bbd-0938-4a1e-ae75-499b6e5d18fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649", "name": "network-vif-plugged", "status": "completed", "tag": "41e6383a-25f2-45be-aa0c-cffb6e1f1143"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:59:58.607421 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-26c749da-c8c6-4116-8ce4-e4220714b3b4 req-5eb98bbd-0938-4a1e-ae75-499b6e5d18fe service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:58.608269 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-26c749da-c8c6-4116-8ce4-e4220714b3b4 req-5eb98bbd-0938-4a1e-ae75-499b6e5d18fe service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:58.638653 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-26c749da-c8c6-4116-8ce4-e4220714b3b4 req-5eb98bbd-0938-4a1e-ae75-499b6e5d18fe service nova] Creating event network-vif-plugged:41e6383a-25f2-45be-aa0c-cffb6e1f1143 for instance 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 on hv-cinder-84213 May 26 13:59:58.665561 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-26c749da-c8c6-4116-8ce4-e4220714b3b4 req-5eb98bbd-0938-4a1e-ae75-499b6e5d18fe service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102252 May 26 13:59:58.666246 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 257/468] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 13:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:59:58.841458 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-966997aa-7ef4-41f7-836e-f934a0b45dab tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:58.842110 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-966997aa-7ef4-41f7-836e-f934a0b45dab tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:58.852343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-966997aa-7ef4-41f7-836e-f934a0b45dab tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:58.853115 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-966997aa-7ef4-41f7-836e-f934a0b45dab tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:58.854370 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-966997aa-7ef4-41f7-836e-f934a0b45dab tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:58.855933 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-966997aa-7ef4-41f7-836e-f934a0b45dab tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:58.966868 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6f895152-408a-408d-88f6-1a75e4b214af tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:58.967875 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6f895152-408a-408d-88f6-1a75e4b214af tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:58.996037 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6f895152-408a-408d-88f6-1a75e4b214af tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:58.996827 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6f895152-408a-408d-88f6-1a75e4b214af tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:58.998066 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6f895152-408a-408d-88f6-1a75e4b214af tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:59.004591 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6f895152-408a-408d-88f6-1a75e4b214af tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:59.073038 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6f895152-408a-408d-88f6-1a75e4b214af tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/ips" status: 200 len: 152 microversion: 2.20 time: 0.111779 May 26 13:59:59.090351 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 258/469] 10.222.0.91 () {60 vars in 1288 bytes} [Thu May 26 13:59:58 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/ips => generated 152 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 13:59:59.387174 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-966997aa-7ef4-41f7-836e-f934a0b45dab tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:59.399234 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-966997aa-7ef4-41f7-836e-f934a0b45dab tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649" status: 200 len: 1314 microversion: 2.1 time: 0.561839 May 26 13:59:59.401428 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 212/470] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 13:59:58 2022] GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:00.417084 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-29c5fef8-4e7a-4c4f-94fb-6012a9e81335 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:00.417690 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-29c5fef8-4e7a-4c4f-94fb-6012a9e81335 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:00.429115 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-29c5fef8-4e7a-4c4f-94fb-6012a9e81335 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:00.429607 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-29c5fef8-4e7a-4c4f-94fb-6012a9e81335 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:00.430384 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-29c5fef8-4e7a-4c4f-94fb-6012a9e81335 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:00.430814 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-29c5fef8-4e7a-4c4f-94fb-6012a9e81335 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:01.029132 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-29c5fef8-4e7a-4c4f-94fb-6012a9e81335 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:01.059030 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-29c5fef8-4e7a-4c4f-94fb-6012a9e81335 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649" status: 200 len: 1314 microversion: 2.1 time: 0.645470 May 26 14:00:01.059636 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 259/471] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:00 2022] GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 => generated 1314 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:02.077343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-77003dd8-5db4-4210-a3f2-abeea8fffb7f tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:02.078883 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-77003dd8-5db4-4210-a3f2-abeea8fffb7f tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:02.087678 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-77003dd8-5db4-4210-a3f2-abeea8fffb7f tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:02.088275 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-77003dd8-5db4-4210-a3f2-abeea8fffb7f tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:02.089344 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-77003dd8-5db4-4210-a3f2-abeea8fffb7f tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:02.089856 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-77003dd8-5db4-4210-a3f2-abeea8fffb7f tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:02.265592 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-77003dd8-5db4-4210-a3f2-abeea8fffb7f tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:02.273056 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-77003dd8-5db4-4210-a3f2-abeea8fffb7f tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649" status: 200 len: 1498 microversion: 2.1 time: 0.199545 May 26 14:00:02.274215 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 213/472] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:02 2022] GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 => generated 1498 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:02.488211 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f3d8cef9-c53d-44cb-8cfc-5fb0c3b0ecfc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:00:02.491862 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f3d8cef9-c53d-44cb-8cfc-5fb0c3b0ecfc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:02.514199 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f3d8cef9-c53d-44cb-8cfc-5fb0c3b0ecfc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:02.514199 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f3d8cef9-c53d-44cb-8cfc-5fb0c3b0ecfc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:02.514199 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f3d8cef9-c53d-44cb-8cfc-5fb0c3b0ecfc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:02.514521 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f3d8cef9-c53d-44cb-8cfc-5fb0c3b0ecfc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:02.623417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-f3d8cef9-c53d-44cb-8cfc-5fb0c3b0ecfc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lazy-loading 'flavor' on Instance uuid 9116ee60-50e6-48c5-bcc1-8e9d08e35458 {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:00:03.200874 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5112398a-802a-4c27-b7af-ae16d717cea2 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:03.201428 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5112398a-802a-4c27-b7af-ae16d717cea2 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:03.209958 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5112398a-802a-4c27-b7af-ae16d717cea2 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:03.210422 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5112398a-802a-4c27-b7af-ae16d717cea2 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:03.211219 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5112398a-802a-4c27-b7af-ae16d717cea2 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:03.211660 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5112398a-802a-4c27-b7af-ae16d717cea2 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:03.244511 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5112398a-802a-4c27-b7af-ae16d717cea2 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 14:00:03.395835 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5112398a-802a-4c27-b7af-ae16d717cea2 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "DELETE /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649" status: 204 len: 0 microversion: 2.1 time: 0.210453 May 26 14:00:03.404448 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 214/473] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 14:00:03 2022] DELETE /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 14:00:03.413774 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cc0febc3-511c-4075-b1af-e39259bf5deb tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:03.415239 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cc0febc3-511c-4075-b1af-e39259bf5deb tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:03.422640 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc0febc3-511c-4075-b1af-e39259bf5deb tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:03.423099 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc0febc3-511c-4075-b1af-e39259bf5deb tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:03.423878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc0febc3-511c-4075-b1af-e39259bf5deb tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:03.427980 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc0febc3-511c-4075-b1af-e39259bf5deb tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:03.672238 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cc0febc3-511c-4075-b1af-e39259bf5deb tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:03.685382 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cc0febc3-511c-4075-b1af-e39259bf5deb tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649" status: 200 len: 1504 microversion: 2.1 time: 0.279433 May 26 14:00:03.685981 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 215/474] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:03 2022] GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 => generated 1504 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:04.702593 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-35761926-5724-492a-a6ce-c91e569ccdec tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:04.703550 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-35761926-5724-492a-a6ce-c91e569ccdec tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:04.713680 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-35761926-5724-492a-a6ce-c91e569ccdec tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:04.714137 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-35761926-5724-492a-a6ce-c91e569ccdec tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:04.714927 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-35761926-5724-492a-a6ce-c91e569ccdec tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:04.715358 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-35761926-5724-492a-a6ce-c91e569ccdec tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:04.871132 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-35761926-5724-492a-a6ce-c91e569ccdec tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:04.878774 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-35761926-5724-492a-a6ce-c91e569ccdec tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649" status: 200 len: 1504 microversion: 2.1 time: 0.180070 May 26 14:00:04.879649 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 216/475] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:04 2022] GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:05.589056 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=4 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:05.895969 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-abd22995-0849-4f8a-b813-935427cf3cee tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:05.896713 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-abd22995-0849-4f8a-b813-935427cf3cee tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:05.905720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-abd22995-0849-4f8a-b813-935427cf3cee tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:05.905720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-abd22995-0849-4f8a-b813-935427cf3cee tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:05.905720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-abd22995-0849-4f8a-b813-935427cf3cee tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:05.906156 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-abd22995-0849-4f8a-b813-935427cf3cee tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:06.049805 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-abd22995-0849-4f8a-b813-935427cf3cee tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:06.058691 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-abd22995-0849-4f8a-b813-935427cf3cee tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649" status: 200 len: 1504 microversion: 2.1 time: 0.166602 May 26 14:00:06.059605 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 217/476] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:05 2022] GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:07.082909 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b5f08a29-4e78-4233-84e8-ccc86b92d57e tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:07.084650 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b5f08a29-4e78-4233-84e8-ccc86b92d57e tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:07.093640 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b5f08a29-4e78-4233-84e8-ccc86b92d57e tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:07.094382 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b5f08a29-4e78-4233-84e8-ccc86b92d57e tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:07.095324 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b5f08a29-4e78-4233-84e8-ccc86b92d57e tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:07.095915 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b5f08a29-4e78-4233-84e8-ccc86b92d57e tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:07.600613 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b5f08a29-4e78-4233-84e8-ccc86b92d57e tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:07.621845 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b5f08a29-4e78-4233-84e8-ccc86b92d57e tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649" status: 200 len: 1504 microversion: 2.1 time: 0.544654 May 26 14:00:07.624598 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 218/477] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:07 2022] GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 => generated 1504 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:00:07.629564 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a906848c-681a-4459-8193-49f530cf94a0 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-918245529", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1017305677", "security_groups": [{"name": "tempest-secgroup-smoke-767251997"}], "networks": [{"uuid": "2e2642a5-f4ea-4c44-b7a8-82a279ead114"}], "block_device_mapping_v2": [{"uuid": "bfb750ed-21f3-45ba-b764-8b7274b59bc2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:00:07.943467 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-a906848c-681a-4459-8193-49f530cf94a0 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] validate_networks() for [('2e2642a5-f4ea-4c44-b7a8-82a279ead114', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 14:00:08.439691 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-a906848c-681a-4459-8193-49f530cf94a0 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 14:00:08.440389 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-a906848c-681a-4459-8193-49f530cf94a0 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 14:00:08.441227 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-a906848c-681a-4459-8193-49f530cf94a0 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 14:00:08.441879 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-a906848c-681a-4459-8193-49f530cf94a0 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 14:00:08.442863 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-a906848c-681a-4459-8193-49f530cf94a0 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 14:00:08.453664 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a906848c-681a-4459-8193-49f530cf94a0 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:08.454454 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a906848c-681a-4459-8193-49f530cf94a0 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:08.455473 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a906848c-681a-4459-8193-49f530cf94a0 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:08.456021 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a906848c-681a-4459-8193-49f530cf94a0 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:08.463978 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f3d8cef9-c53d-44cb-8cfc-5fb0c3b0ecfc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "POST /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/action" status: 202 len: 0 microversion: 2.20 time: 5.986964 May 26 14:00:08.469254 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 260/478] 10.222.0.91 () {62 vars in 1318 bytes} [Thu May 26 14:00:02 2022] POST /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/action => generated 0 bytes in 5993 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 14:00:08.476732 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7e91568c-f684-48fa-945e-6ae87ec17e38 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Action: 'create', calling method: .version_select at 0x7f25a5407af0>, body: {"keypair": {"name": "tempest-keypair-1630475897", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYWdqWhwBtF4n5+aTxqE4CmxHOMKBovlI/JWwiouBvrHDN+lscjzHOEOlfMdR8+VlLYDIQLA5u4kegPS2jAlLuQ+HnSpdy3iTbX74cd4ntezbvtuGPXiB0Bez3NwhjJMQ=="}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:00:08.492901 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-a906848c-681a-4459-8193-49f530cf94a0 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Getting quotas for project 4d13c9a0ad1146158525c3398ff4de2a. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 14:00:08.493488 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-7e91568c-f684-48fa-945e-6ae87ec17e38 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Getting quotas for project af9d168c40ea4df99b495eb06245d066. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 14:00:08.498317 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-7e91568c-f684-48fa-945e-6ae87ec17e38 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Getting quotas for user 592975b43454407abde6c7cab2504982 and project af9d168c40ea4df99b495eb06245d066. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 14:00:08.498893 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-a906848c-681a-4459-8193-49f530cf94a0 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Getting quotas for user ecacca157e3a43b79659f78e4beb0c5e and project 4d13c9a0ad1146158525c3398ff4de2a. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 14:00:08.552715 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7e91568c-f684-48fa-945e-6ae87ec17e38 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.080970 May 26 14:00:08.559878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 261/479] 10.222.0.91 () {60 vars in 1158 bytes} [Thu May 26 14:00:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:00:08.568931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-a2dab2e6-d3a2-426a-a2a5-e44261218f2c req-8587cb3d-501a-473d-93a6-2369f53a4194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649", "name": "network-vif-deleted", "tag": "41e6383a-25f2-45be-aa0c-cffb6e1f1143"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:00:08.580351 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-a2dab2e6-d3a2-426a-a2a5-e44261218f2c req-8587cb3d-501a-473d-93a6-2369f53a4194 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:08.581056 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-a2dab2e6-d3a2-426a-a2a5-e44261218f2c req-8587cb3d-501a-473d-93a6-2369f53a4194 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:08.592861 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a906848c-681a-4459-8193-49f530cf94a0 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 14:00:08.596142 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a906848c-681a-4459-8193-49f530cf94a0 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bfb750ed-21f3-45ba-b764-8b7274b59bc2',volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 14:00:08.597084 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-a2dab2e6-d3a2-426a-a2a5-e44261218f2c req-8587cb3d-501a-473d-93a6-2369f53a4194 service nova] Creating event network-vif-deleted:41e6383a-25f2-45be-aa0c-cffb6e1f1143 for instance 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 on hv-cinder-84213 May 26 14:00:08.608669 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-a2dab2e6-d3a2-426a-a2a5-e44261218f2c req-8587cb3d-501a-473d-93a6-2369f53a4194 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047521 May 26 14:00:08.609541 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 262/480] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:00:08.617027 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-bda88161-b5f7-4623-a5b2-b7f24d800146 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Action: 'create', calling method: .version_select at 0x7f25a544c790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1119065625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKokifS8ZLWJPxjv22uXd4cIFeRqNelpO0KigQ/adhG7Tv0tTCHHuqK1o7v218Nb6dMsmnmVRO2cwdcfAtUSA6DSuIoM9yBbBAjmh3qaBPkcuqkz6rXPdWtcmAbwkXy77g=="}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:00:08.632214 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-bda88161-b5f7-4623-a5b2-b7f24d800146 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Getting quotas for project 08ed6980f1214f6789f94f34a4c68e6e. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 14:00:08.638524 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-bda88161-b5f7-4623-a5b2-b7f24d800146 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Getting quotas for user 0e7ef003bc5642feadfa1f9f631ef903 and project 08ed6980f1214f6789f94f34a4c68e6e. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 14:00:08.672886 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-bda88161-b5f7-4623-a5b2-b7f24d800146 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.060652 May 26 14:00:08.674321 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 263/481] 10.222.0.91 () {60 vars in 1158 bytes} [Thu May 26 14:00:08 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:00:08.681649 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3bf65c1c-88d2-4620-80c2-f695b49626de tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:08.683385 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3bf65c1c-88d2-4620-80c2-f695b49626de tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:08.694830 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3bf65c1c-88d2-4620-80c2-f695b49626de tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:08.696162 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3bf65c1c-88d2-4620-80c2-f695b49626de tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:08.697932 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3bf65c1c-88d2-4620-80c2-f695b49626de tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:08.698721 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3bf65c1c-88d2-4620-80c2-f695b49626de tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:08.834657 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a906848c-681a-4459-8193-49f530cf94a0 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.208721 May 26 14:00:08.835301 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 219/482] 10.222.0.91 () {60 vars in 1146 bytes} [Thu May 26 14:00:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 14:00:08.840738 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b2023711-9547-4bd1-8a4a-7d8f2a13d258 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:08.841455 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b2023711-9547-4bd1-8a4a-7d8f2a13d258 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:08.847724 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b2023711-9547-4bd1-8a4a-7d8f2a13d258 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:08.848175 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b2023711-9547-4bd1-8a4a-7d8f2a13d258 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:08.849102 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b2023711-9547-4bd1-8a4a-7d8f2a13d258 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:08.849595 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b2023711-9547-4bd1-8a4a-7d8f2a13d258 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:08.914533 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b2023711-9547-4bd1-8a4a-7d8f2a13d258 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:08.922744 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b2023711-9547-4bd1-8a4a-7d8f2a13d258 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:08.923530 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-b2023711-9547-4bd1-8a4a-7d8f2a13d258 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lazy-loading 'fault' on Instance uuid 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:00:09.016775 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b2023711-9547-4bd1-8a4a-7d8f2a13d258 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb759cf823b45d2aa35fdcacc7ac3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12082647641d4ece974c66384e3bf169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:09.042879 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b2023711-9547-4bd1-8a4a-7d8f2a13d258 tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649" status: 200 len: 1304 microversion: 2.1 time: 0.204534 May 26 14:00:09.044043 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 220/483] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:08 2022] GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 => generated 1304 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:09.066394 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f8eb8a23-8ec2-4f8d-9b08-9440db580337 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1589441255", "imageRef": "a6cb8c95-2247-4d8a-8f00-d68079e68174", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1119065625", "networks": [{"uuid": "dc9a3522-5732-4ae3-9805-a5cd81aa181e"}]}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:00:09.121029 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3bf65c1c-88d2-4620-80c2-f695b49626de tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:09.145692 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3bf65c1c-88d2-4620-80c2-f695b49626de tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:09.151803 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3bf65c1c-88d2-4620-80c2-f695b49626de tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:09.154238 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3bf65c1c-88d2-4620-80c2-f695b49626de tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1724 microversion: 2.20 time: 0.478333 May 26 14:00:09.155460 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 264/484] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:08 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1724 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:09.164391 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-541e9588-67b6-48ef-af8a-28b09c9b54ab tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:09.165463 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-541e9588-67b6-48ef-af8a-28b09c9b54ab tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:09.171691 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-f8eb8a23-8ec2-4f8d-9b08-9440db580337 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] validate_networks() for [('dc9a3522-5732-4ae3-9805-a5cd81aa181e', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 14:00:09.300692 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-541e9588-67b6-48ef-af8a-28b09c9b54ab tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:09.312464 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-541e9588-67b6-48ef-af8a-28b09c9b54ab tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1088 microversion: 2.1 time: 0.154478 May 26 14:00:09.315200 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 265/485] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:09 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1088 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:09.811541 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-f8eb8a23-8ec2-4f8d-9b08-9440db580337 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 14:00:09.812162 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-f8eb8a23-8ec2-4f8d-9b08-9440db580337 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 14:00:09.812878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-f8eb8a23-8ec2-4f8d-9b08-9440db580337 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 14:00:09.813478 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-f8eb8a23-8ec2-4f8d-9b08-9440db580337 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 14:00:09.813991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-f8eb8a23-8ec2-4f8d-9b08-9440db580337 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 14:00:09.826043 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f8eb8a23-8ec2-4f8d-9b08-9440db580337 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:09.826790 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f8eb8a23-8ec2-4f8d-9b08-9440db580337 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:09.827719 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f8eb8a23-8ec2-4f8d-9b08-9440db580337 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:09.828252 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f8eb8a23-8ec2-4f8d-9b08-9440db580337 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:09.857815 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-f8eb8a23-8ec2-4f8d-9b08-9440db580337 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Getting quotas for project 08ed6980f1214f6789f94f34a4c68e6e. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 14:00:09.863029 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-f8eb8a23-8ec2-4f8d-9b08-9440db580337 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Getting quotas for user 0e7ef003bc5642feadfa1f9f631ef903 and project 08ed6980f1214f6789f94f34a4c68e6e. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 14:00:09.881427 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f8eb8a23-8ec2-4f8d-9b08-9440db580337 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 14:00:09.883870 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f8eb8a23-8ec2-4f8d-9b08-9440db580337 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a6cb8c95-2247-4d8a-8f00-d68079e68174',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 14:00:09.945451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f8eb8a23-8ec2-4f8d-9b08-9440db580337 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.894566 May 26 14:00:09.947328 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 221/486] 10.222.0.91 () {60 vars in 1146 bytes} [Thu May 26 14:00:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 14:00:09.963453 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-317fc2f3-1281-469a-96bc-fc74f7b2ee7d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:09.967472 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-317fc2f3-1281-469a-96bc-fc74f7b2ee7d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:10.062798 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7267467e-785e-4982-8634-f237eb8b5b5c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:10.063560 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7267467e-785e-4982-8634-f237eb8b5b5c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] [instance: 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:10.077885 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-317fc2f3-1281-469a-96bc-fc74f7b2ee7d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:10.080540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7267467e-785e-4982-8634-f237eb8b5b5c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:10.081268 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7267467e-785e-4982-8634-f237eb8b5b5c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:10.082455 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7267467e-785e-4982-8634-f237eb8b5b5c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:10.083056 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7267467e-785e-4982-8634-f237eb8b5b5c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:10.086042 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-317fc2f3-1281-469a-96bc-fc74f7b2ee7d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1259 microversion: 2.1 time: 0.132573 May 26 14:00:10.088914 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 266/487] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:09 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1259 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:00:10.126699 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-7267467e-785e-4982-8634-f237eb8b5b5c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] HTTP exception thrown: Instance 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 could not be found. May 26 14:00:10.128795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7267467e-785e-4982-8634-f237eb8b5b5c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Request method failure captured: May 26 14:00:10.128795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 HTTP/1.1 May 26 14:00:10.128795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 14:00:10.128795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 14:00:10.128795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 14:00:10.128795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 14:00:10.128795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 14:00:10.128795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 14:00:10.128795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 14:00:10.128795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 14:00:10.128795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4eip47b0amme2b6ONx5yE67oMBefO_EAKVNpUhhpsGog2gr8TZXNa7lzj022TyxLyDZUtWuRlc8Li8Iku6UUfh4RLzBf98h5yXacVNrMea6oDaj-8EPHw2kJWTyUOgkMtGPeF4K3MYsU7z0xJQ1n3QwvFMaQ6IHC2GIQIB-ZYUG9rI May 26 14:00:10.128795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 14:00:10.128795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 14:00:10.128795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 14:00:10.128795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 14:00:10.128795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 14:00:10.128795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 14:00:10.128795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: 12082647641d4ece974c66384e3bf169 May 26 14:00:10.128795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesActionsTest-716628881 May 26 14:00:10.128795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 14:00:10.128795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 14:00:10.130392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/12082647641d4ece974c66384e3bf169"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/12082647641d4ece974c66384e3bf169"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/12082647641d4ece974c66384e3bf169"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_12082647641d4ece974c66384e3bf169", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:00:10.130392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesActionsTest-716628881 May 26 14:00:10.130392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 12082647641d4ece974c66384e3bf169 May 26 14:00:10.130392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesActionsTest-716628881 May 26 14:00:10.130392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesActionsTest-716628881-project May 26 14:00:10.130392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 14:00:10.130392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 14:00:10.130392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: 2eb759cf823b45d2aa35fdcacc7ac3e8 May 26 14:00:10.130392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesActionsTest-716628881-project May 26 14:00:10.130392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: > May 26 14:00:10.130392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Instance 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 could not be found. May 26 14:00:10.130392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'id': '7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649'} May 26 14:00:10.131168 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:00:10.131168 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:00:10.131168 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:00:10.131168 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:00:10.131168 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:00:10.131168 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:00:10.131168 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:00:10.131168 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:00:10.131168 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:00:10.131168 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:00:10.131168 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 could not be found. May 26 14:00:10.131168 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:00:10.131168 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:00:10.131168 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:00:10.131168 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:00:10.131168 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:00:10.131168 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:00:10.131168 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:00:10.131168 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:00:10.131168 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:00:10.132540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:00:10.132540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:00:10.132540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:00:10.132540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:00:10.132540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:00:10.132540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:00:10.132540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:00:10.132540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 could not be found. May 26 14:00:10.132540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:00:10.132540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:00:10.132540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:00:10.132540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:00:10.132540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:00:10.132540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:00:10.132540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:00:10.132540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:00:10.132540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 could not be found. May 26 14:00:10.132540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:00:10.135562 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7267467e-785e-4982-8634-f237eb8b5b5c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] Returning 404 to user: Instance 7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:00:10.135562 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7267467e-785e-4982-8634-f237eb8b5b5c tempest-VolumesActionsTest-716628881 tempest-VolumesActionsTest-716628881-project] 10.222.0.91 "GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649" status: 404 len: 111 microversion: 2.1 time: 0.072828 May 26 14:00:10.135562 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 222/488] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:10 2022] GET /compute/v2.1/servers/7dcbaef5-7ff8-4edf-9ccf-e1053c6c6649 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:00:10.173099 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-33d28d5c-e506-4c5d-9da8-9f571ed216a8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:10.173816 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-33d28d5c-e506-4c5d-9da8-9f571ed216a8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:10.182320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-33d28d5c-e506-4c5d-9da8-9f571ed216a8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:10.182997 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-33d28d5c-e506-4c5d-9da8-9f571ed216a8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:10.184391 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-33d28d5c-e506-4c5d-9da8-9f571ed216a8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:10.184983 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-33d28d5c-e506-4c5d-9da8-9f571ed216a8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:10.333271 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d927ef7e-8a2a-49d3-86e5-9bc67ecb618c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:10.334331 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d927ef7e-8a2a-49d3-86e5-9bc67ecb618c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:10.343243 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d927ef7e-8a2a-49d3-86e5-9bc67ecb618c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:10.343882 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d927ef7e-8a2a-49d3-86e5-9bc67ecb618c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:10.344973 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d927ef7e-8a2a-49d3-86e5-9bc67ecb618c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:10.345659 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d927ef7e-8a2a-49d3-86e5-9bc67ecb618c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:10.468237 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d927ef7e-8a2a-49d3-86e5-9bc67ecb618c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:10.477432 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d927ef7e-8a2a-49d3-86e5-9bc67ecb618c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1186 microversion: 2.1 time: 0.149157 May 26 14:00:10.483107 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 223/489] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:10 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1186 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:10.522583 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-33d28d5c-e506-4c5d-9da8-9f571ed216a8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:10.542002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-33d28d5c-e506-4c5d-9da8-9f571ed216a8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:10.547528 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-33d28d5c-e506-4c5d-9da8-9f571ed216a8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:10.549188 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-33d28d5c-e506-4c5d-9da8-9f571ed216a8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1724 microversion: 2.20 time: 0.380166 May 26 14:00:10.552347 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 267/490] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:10 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1724 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:11.105690 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-633c7269-df51-42c3-a2d5-a3c14c0d6138 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:11.106309 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-633c7269-df51-42c3-a2d5-a3c14c0d6138 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:11.114968 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-633c7269-df51-42c3-a2d5-a3c14c0d6138 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:11.115416 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-633c7269-df51-42c3-a2d5-a3c14c0d6138 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:11.116196 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-633c7269-df51-42c3-a2d5-a3c14c0d6138 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:11.116635 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-633c7269-df51-42c3-a2d5-a3c14c0d6138 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:11.286121 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-633c7269-df51-42c3-a2d5-a3c14c0d6138 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:11.293805 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-633c7269-df51-42c3-a2d5-a3c14c0d6138 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1255 microversion: 2.1 time: 0.192432 May 26 14:00:11.294676 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 224/491] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:11 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1255 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:11.402755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-486767d7-d906-4616-a332-f85a6f91ff5d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-43041580", "imageRef": "bcaacfae-fe2c-455f-a6e1-b08361c6fa8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f7e5c2e-dcd0-44c0-a251-a7bcffefb292"}], "security_groups": [{"name": "tempest-securitygroup--1512592163"}], "key_name": "tempest-keypair-1630475897", "user_data": "}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:00:11.500079 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3e83d786-6f97-4ced-a350-2b496a353f1c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:11.500766 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3e83d786-6f97-4ced-a350-2b496a353f1c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:11.507710 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3e83d786-6f97-4ced-a350-2b496a353f1c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:11.508231 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3e83d786-6f97-4ced-a350-2b496a353f1c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:11.509071 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3e83d786-6f97-4ced-a350-2b496a353f1c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:11.510409 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3e83d786-6f97-4ced-a350-2b496a353f1c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:11.541320 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:11.582094 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-486767d7-d906-4616-a332-f85a6f91ff5d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] validate_networks() for [('5f7e5c2e-dcd0-44c0-a251-a7bcffefb292', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 14:00:11.690283 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3e83d786-6f97-4ced-a350-2b496a353f1c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:11.699095 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3e83d786-6f97-4ced-a350-2b496a353f1c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1204 microversion: 2.1 time: 0.202734 May 26 14:00:11.699668 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 225/492] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:11 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1204 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:11.706098 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c1123a29-c46b-4214-9bdb-763ab06beca3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:11.706972 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c1123a29-c46b-4214-9bdb-763ab06beca3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:11.713915 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c1123a29-c46b-4214-9bdb-763ab06beca3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:11.714632 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c1123a29-c46b-4214-9bdb-763ab06beca3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:11.716213 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c1123a29-c46b-4214-9bdb-763ab06beca3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:11.716876 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c1123a29-c46b-4214-9bdb-763ab06beca3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:12.098246 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c1123a29-c46b-4214-9bdb-763ab06beca3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:12.108540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c1123a29-c46b-4214-9bdb-763ab06beca3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:12.110527 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c1123a29-c46b-4214-9bdb-763ab06beca3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:12.112434 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c1123a29-c46b-4214-9bdb-763ab06beca3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1724 microversion: 2.20 time: 0.410130 May 26 14:00:12.113005 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 226/493] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:11 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1724 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:12.311744 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dd267eba-912b-4cb4-bb5a-f8e1b38f2cef tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:12.312470 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-dd267eba-912b-4cb4-bb5a-f8e1b38f2cef tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:12.329615 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dd267eba-912b-4cb4-bb5a-f8e1b38f2cef tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:12.330162 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dd267eba-912b-4cb4-bb5a-f8e1b38f2cef tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:12.331118 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dd267eba-912b-4cb4-bb5a-f8e1b38f2cef tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:12.331662 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dd267eba-912b-4cb4-bb5a-f8e1b38f2cef tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:12.507891 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dd267eba-912b-4cb4-bb5a-f8e1b38f2cef tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:12.528048 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dd267eba-912b-4cb4-bb5a-f8e1b38f2cef tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1317 microversion: 2.1 time: 0.220724 May 26 14:00:12.529208 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 227/494] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:12 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:12.717788 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-aa4ae378-3b89-45ce-a33e-549e6ebd8d29 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:12.719005 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-aa4ae378-3b89-45ce-a33e-549e6ebd8d29 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:12.741130 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aa4ae378-3b89-45ce-a33e-549e6ebd8d29 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:12.742405 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aa4ae378-3b89-45ce-a33e-549e6ebd8d29 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:12.743944 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aa4ae378-3b89-45ce-a33e-549e6ebd8d29 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:12.744389 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aa4ae378-3b89-45ce-a33e-549e6ebd8d29 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:13.239528 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-486767d7-d906-4616-a332-f85a6f91ff5d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 14:00:13.240044 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-486767d7-d906-4616-a332-f85a6f91ff5d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 14:00:13.240411 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-486767d7-d906-4616-a332-f85a6f91ff5d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 14:00:13.240817 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-486767d7-d906-4616-a332-f85a6f91ff5d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 14:00:13.241267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-486767d7-d906-4616-a332-f85a6f91ff5d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 14:00:13.251390 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-486767d7-d906-4616-a332-f85a6f91ff5d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:13.251836 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-486767d7-d906-4616-a332-f85a6f91ff5d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:13.252633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-486767d7-d906-4616-a332-f85a6f91ff5d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:13.253063 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-486767d7-d906-4616-a332-f85a6f91ff5d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:13.271908 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-486767d7-d906-4616-a332-f85a6f91ff5d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Getting quotas for project af9d168c40ea4df99b495eb06245d066. Resources: {'ram', 'cores', 'instances'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 14:00:13.276121 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-486767d7-d906-4616-a332-f85a6f91ff5d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Getting quotas for user 592975b43454407abde6c7cab2504982 and project af9d168c40ea4df99b495eb06245d066. Resources: {'ram', 'cores', 'instances'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 14:00:13.286990 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-486767d7-d906-4616-a332-f85a6f91ff5d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 14:00:13.289313 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-486767d7-d906-4616-a332-f85a6f91ff5d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bcaacfae-fe2c-455f-a6e1-b08361c6fa8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 14:00:13.292037 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-aa4ae378-3b89-45ce-a33e-549e6ebd8d29 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:13.301171 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-aa4ae378-3b89-45ce-a33e-549e6ebd8d29 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1271 microversion: 2.1 time: 0.588464 May 26 14:00:13.302332 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 228/495] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:12 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1271 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:00:13.308428 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c483d211-d886-44eb-8225-df5cc3bab9da tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:13.309286 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c483d211-d886-44eb-8225-df5cc3bab9da tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:13.317137 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c483d211-d886-44eb-8225-df5cc3bab9da tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:13.317698 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c483d211-d886-44eb-8225-df5cc3bab9da tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:13.318530 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c483d211-d886-44eb-8225-df5cc3bab9da tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:13.319090 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c483d211-d886-44eb-8225-df5cc3bab9da tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:13.343036 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-486767d7-d906-4616-a332-f85a6f91ff5d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.944493 May 26 14:00:13.343950 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 268/496] 10.222.0.91 () {60 vars in 1146 bytes} [Thu May 26 14:00:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 1946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 14:00:13.354356 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-60da8189-8202-42b9-882b-30c5bdec9574 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:13.355223 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-60da8189-8202-42b9-882b-30c5bdec9574 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:13.439191 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-60da8189-8202-42b9-882b-30c5bdec9574 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:13.447947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-60da8189-8202-42b9-882b-30c5bdec9574 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1240 microversion: 2.1 time: 0.097932 May 26 14:00:13.448728 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 269/497] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:13 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1240 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:00:13.545827 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-82b07bf2-5076-4398-b466-c63d1495a540 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:13.546601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-82b07bf2-5076-4398-b466-c63d1495a540 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:13.548544 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c483d211-d886-44eb-8225-df5cc3bab9da tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:13.554933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-82b07bf2-5076-4398-b466-c63d1495a540 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:13.555382 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-82b07bf2-5076-4398-b466-c63d1495a540 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:13.556859 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-82b07bf2-5076-4398-b466-c63d1495a540 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:13.557390 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-82b07bf2-5076-4398-b466-c63d1495a540 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:13.563938 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c483d211-d886-44eb-8225-df5cc3bab9da tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:13.573255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c483d211-d886-44eb-8225-df5cc3bab9da tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:13.574658 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c483d211-d886-44eb-8225-df5cc3bab9da tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1724 microversion: 2.20 time: 0.270894 May 26 14:00:13.575243 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 229/498] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:13 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:13.854107 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-82b07bf2-5076-4398-b466-c63d1495a540 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:13.862607 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-82b07bf2-5076-4398-b466-c63d1495a540 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.321040 May 26 14:00:13.863195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 270/499] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:13 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:00:14.319271 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-34a435ac-7f6a-4b84-8c90-3d563380ef20 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:14.319834 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-34a435ac-7f6a-4b84-8c90-3d563380ef20 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:14.325962 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-34a435ac-7f6a-4b84-8c90-3d563380ef20 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:14.326437 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-34a435ac-7f6a-4b84-8c90-3d563380ef20 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:14.327204 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-34a435ac-7f6a-4b84-8c90-3d563380ef20 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:14.327636 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-34a435ac-7f6a-4b84-8c90-3d563380ef20 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:14.468315 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f8d865f7-3935-4f1e-a21c-3a771ca6af20 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:14.469040 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f8d865f7-3935-4f1e-a21c-3a771ca6af20 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:14.476717 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-34a435ac-7f6a-4b84-8c90-3d563380ef20 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:14.483149 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f8d865f7-3935-4f1e-a21c-3a771ca6af20 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:14.483650 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f8d865f7-3935-4f1e-a21c-3a771ca6af20 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:14.484521 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f8d865f7-3935-4f1e-a21c-3a771ca6af20 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:14.484990 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f8d865f7-3935-4f1e-a21c-3a771ca6af20 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:14.488960 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-34a435ac-7f6a-4b84-8c90-3d563380ef20 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1271 microversion: 2.1 time: 0.173491 May 26 14:00:14.489925 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 230/500] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:14 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1271 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:14.564020 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f8d865f7-3935-4f1e-a21c-3a771ca6af20 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:14.572340 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f8d865f7-3935-4f1e-a21c-3a771ca6af20 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1244 microversion: 2.1 time: 0.111018 May 26 14:00:14.580702 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 271/501] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:14 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1244 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:14.594368 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-73e020c0-18f8-4797-8618-c6a5b34d2888 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:14.595051 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-73e020c0-18f8-4797-8618-c6a5b34d2888 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:14.601434 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-73e020c0-18f8-4797-8618-c6a5b34d2888 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:14.602094 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-73e020c0-18f8-4797-8618-c6a5b34d2888 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:14.603902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-73e020c0-18f8-4797-8618-c6a5b34d2888 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:14.604604 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-73e020c0-18f8-4797-8618-c6a5b34d2888 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:14.744898 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-73e020c0-18f8-4797-8618-c6a5b34d2888 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:14.753068 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-73e020c0-18f8-4797-8618-c6a5b34d2888 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:14.754626 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-73e020c0-18f8-4797-8618-c6a5b34d2888 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:14.755780 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-73e020c0-18f8-4797-8618-c6a5b34d2888 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1724 microversion: 2.20 time: 0.166387 May 26 14:00:14.756326 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 231/502] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:14 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:14.879398 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1305bd60-305d-4afc-ac92-b9f2abb1bbe3 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:14.880208 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1305bd60-305d-4afc-ac92-b9f2abb1bbe3 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:14.886878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1305bd60-305d-4afc-ac92-b9f2abb1bbe3 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:14.887325 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1305bd60-305d-4afc-ac92-b9f2abb1bbe3 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:14.888295 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1305bd60-305d-4afc-ac92-b9f2abb1bbe3 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:14.888732 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1305bd60-305d-4afc-ac92-b9f2abb1bbe3 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:15.023459 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1305bd60-305d-4afc-ac92-b9f2abb1bbe3 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:15.031508 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1305bd60-305d-4afc-ac92-b9f2abb1bbe3 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.156006 May 26 14:00:15.032187 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 272/503] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:14 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:15.506664 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9429477b-a887-4fa7-a7e6-ada89b888c12 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:15.507998 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9429477b-a887-4fa7-a7e6-ada89b888c12 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:15.515075 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9429477b-a887-4fa7-a7e6-ada89b888c12 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:15.515805 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9429477b-a887-4fa7-a7e6-ada89b888c12 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:15.516785 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9429477b-a887-4fa7-a7e6-ada89b888c12 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:15.517486 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9429477b-a887-4fa7-a7e6-ada89b888c12 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:15.594154 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6fed3667-ba45-4e12-9e33-ce09c6b6a35c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:15.595239 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6fed3667-ba45-4e12-9e33-ce09c6b6a35c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:15.606243 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6fed3667-ba45-4e12-9e33-ce09c6b6a35c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:15.607266 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6fed3667-ba45-4e12-9e33-ce09c6b6a35c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:15.608697 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6fed3667-ba45-4e12-9e33-ce09c6b6a35c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:15.612773 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6fed3667-ba45-4e12-9e33-ce09c6b6a35c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:15.716306 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6fed3667-ba45-4e12-9e33-ce09c6b6a35c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:15.724972 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6fed3667-ba45-4e12-9e33-ce09c6b6a35c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1244 microversion: 2.1 time: 0.137633 May 26 14:00:15.725609 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 273/504] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:15 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1244 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:15.733258 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9429477b-a887-4fa7-a7e6-ada89b888c12 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:15.741776 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9429477b-a887-4fa7-a7e6-ada89b888c12 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1271 microversion: 2.1 time: 0.238823 May 26 14:00:15.742268 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 232/505] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:15 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1271 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:15.774468 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5c6227c4-15a0-4fc6-a753-dadcfdc6688e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:15.775109 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5c6227c4-15a0-4fc6-a753-dadcfdc6688e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:15.781127 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5c6227c4-15a0-4fc6-a753-dadcfdc6688e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:15.781592 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5c6227c4-15a0-4fc6-a753-dadcfdc6688e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:15.782341 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5c6227c4-15a0-4fc6-a753-dadcfdc6688e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:15.782769 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5c6227c4-15a0-4fc6-a753-dadcfdc6688e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:15.786719 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:15.923982 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5c6227c4-15a0-4fc6-a753-dadcfdc6688e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:15.933112 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5c6227c4-15a0-4fc6-a753-dadcfdc6688e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:15.934645 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5c6227c4-15a0-4fc6-a753-dadcfdc6688e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:15.935823 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5c6227c4-15a0-4fc6-a753-dadcfdc6688e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1724 microversion: 2.20 time: 0.165464 May 26 14:00:15.936731 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 274/506] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:15 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:16.054749 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a57ffdb6-104e-4d0b-a4f0-55e038979402 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:16.055352 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a57ffdb6-104e-4d0b-a4f0-55e038979402 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:16.063750 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a57ffdb6-104e-4d0b-a4f0-55e038979402 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:16.064200 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a57ffdb6-104e-4d0b-a4f0-55e038979402 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:16.065110 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a57ffdb6-104e-4d0b-a4f0-55e038979402 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:16.065579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a57ffdb6-104e-4d0b-a4f0-55e038979402 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:16.206670 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a57ffdb6-104e-4d0b-a4f0-55e038979402 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:16.214596 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a57ffdb6-104e-4d0b-a4f0-55e038979402 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.165039 May 26 14:00:16.215161 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 233/507] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:16 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:16.741784 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a47af7a6-9829-4df1-8062-276cb4c6c221 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:16.742396 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a47af7a6-9829-4df1-8062-276cb4c6c221 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:16.749034 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a47af7a6-9829-4df1-8062-276cb4c6c221 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:16.749519 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a47af7a6-9829-4df1-8062-276cb4c6c221 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:16.750294 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a47af7a6-9829-4df1-8062-276cb4c6c221 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:16.750730 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a47af7a6-9829-4df1-8062-276cb4c6c221 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:16.758812 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0c37b8e5-235c-4049-960c-57ecb2d17224 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:16.759422 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0c37b8e5-235c-4049-960c-57ecb2d17224 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:16.765788 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0c37b8e5-235c-4049-960c-57ecb2d17224 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:16.766240 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0c37b8e5-235c-4049-960c-57ecb2d17224 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:16.767005 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0c37b8e5-235c-4049-960c-57ecb2d17224 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:16.767444 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0c37b8e5-235c-4049-960c-57ecb2d17224 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:16.816928 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a47af7a6-9829-4df1-8062-276cb4c6c221 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:16.824527 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a47af7a6-9829-4df1-8062-276cb4c6c221 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1244 microversion: 2.1 time: 0.086568 May 26 14:00:16.825104 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 275/508] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:16 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:16.921807 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0c37b8e5-235c-4049-960c-57ecb2d17224 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:16.929120 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0c37b8e5-235c-4049-960c-57ecb2d17224 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1271 microversion: 2.1 time: 0.174096 May 26 14:00:16.929651 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 234/509] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:16 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1271 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:00:16.953798 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-20ff48d8-de1d-4e76-a26a-65abf9c740b4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:16.954404 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-20ff48d8-de1d-4e76-a26a-65abf9c740b4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:16.960339 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-20ff48d8-de1d-4e76-a26a-65abf9c740b4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:16.960786 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-20ff48d8-de1d-4e76-a26a-65abf9c740b4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:16.961583 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-20ff48d8-de1d-4e76-a26a-65abf9c740b4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:16.962020 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-20ff48d8-de1d-4e76-a26a-65abf9c740b4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:17.092432 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-20ff48d8-de1d-4e76-a26a-65abf9c740b4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:17.100177 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-20ff48d8-de1d-4e76-a26a-65abf9c740b4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:17.101677 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-20ff48d8-de1d-4e76-a26a-65abf9c740b4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:17.102824 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-20ff48d8-de1d-4e76-a26a-65abf9c740b4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1724 microversion: 2.20 time: 0.152935 May 26 14:00:17.103379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 276/510] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:16 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:17.231018 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ddcc0848-63ce-4d50-98d3-d6382dd2b1d0 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:17.231638 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ddcc0848-63ce-4d50-98d3-d6382dd2b1d0 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:17.237768 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ddcc0848-63ce-4d50-98d3-d6382dd2b1d0 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:17.238028 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ddcc0848-63ce-4d50-98d3-d6382dd2b1d0 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:17.238777 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ddcc0848-63ce-4d50-98d3-d6382dd2b1d0 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:17.239206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ddcc0848-63ce-4d50-98d3-d6382dd2b1d0 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:17.367939 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ddcc0848-63ce-4d50-98d3-d6382dd2b1d0 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:17.375669 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ddcc0848-63ce-4d50-98d3-d6382dd2b1d0 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.148481 May 26 14:00:17.376231 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 235/511] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:17 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:17.841326 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-587e08b2-6742-49c3-9d2f-3ba7bd768255 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:17.842056 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-587e08b2-6742-49c3-9d2f-3ba7bd768255 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:17.844230 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:17.849599 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-587e08b2-6742-49c3-9d2f-3ba7bd768255 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:17.850049 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-587e08b2-6742-49c3-9d2f-3ba7bd768255 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:17.850822 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-587e08b2-6742-49c3-9d2f-3ba7bd768255 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:17.851259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-587e08b2-6742-49c3-9d2f-3ba7bd768255 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:17.913481 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-587e08b2-6742-49c3-9d2f-3ba7bd768255 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:17.922036 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-587e08b2-6742-49c3-9d2f-3ba7bd768255 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1244 microversion: 2.1 time: 0.084534 May 26 14:00:17.922700 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 277/512] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:17 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:17.945731 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9b3710aa-c6af-4326-925e-72a09cc3ab14 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:17.946399 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9b3710aa-c6af-4326-925e-72a09cc3ab14 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:17.952931 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b3710aa-c6af-4326-925e-72a09cc3ab14 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:17.953406 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b3710aa-c6af-4326-925e-72a09cc3ab14 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:17.954174 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b3710aa-c6af-4326-925e-72a09cc3ab14 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:17.954800 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b3710aa-c6af-4326-925e-72a09cc3ab14 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:18.084761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9b3710aa-c6af-4326-925e-72a09cc3ab14 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:18.092781 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9b3710aa-c6af-4326-925e-72a09cc3ab14 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1271 microversion: 2.1 time: 0.150855 May 26 14:00:18.093381 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 236/513] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:17 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1271 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:00:18.119647 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c21efec4-aa78-4693-91d1-b88d0ba2c0ec tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:18.120245 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c21efec4-aa78-4693-91d1-b88d0ba2c0ec tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:18.126160 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c21efec4-aa78-4693-91d1-b88d0ba2c0ec tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:18.126600 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c21efec4-aa78-4693-91d1-b88d0ba2c0ec tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:18.127369 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c21efec4-aa78-4693-91d1-b88d0ba2c0ec tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:18.127798 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c21efec4-aa78-4693-91d1-b88d0ba2c0ec tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:18.279843 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c21efec4-aa78-4693-91d1-b88d0ba2c0ec tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:18.289058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c21efec4-aa78-4693-91d1-b88d0ba2c0ec tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:18.291213 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c21efec4-aa78-4693-91d1-b88d0ba2c0ec tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:18.292330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c21efec4-aa78-4693-91d1-b88d0ba2c0ec tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1724 microversion: 2.20 time: 0.176569 May 26 14:00:18.296672 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 278/514] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:18 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:18.394567 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-046d9269-3db8-4fed-b416-e676591034b8 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:18.395357 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-046d9269-3db8-4fed-b416-e676591034b8 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:18.403193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-046d9269-3db8-4fed-b416-e676591034b8 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:18.404446 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-046d9269-3db8-4fed-b416-e676591034b8 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:18.405275 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-046d9269-3db8-4fed-b416-e676591034b8 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:18.405719 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-046d9269-3db8-4fed-b416-e676591034b8 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:18.535593 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-046d9269-3db8-4fed-b416-e676591034b8 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:18.543171 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-046d9269-3db8-4fed-b416-e676591034b8 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.154032 May 26 14:00:18.543738 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 237/515] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:18 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:18.939292 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a488ec9d-0248-44d7-9d0b-2d485de3d51c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:18.940075 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a488ec9d-0248-44d7-9d0b-2d485de3d51c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:18.946522 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a488ec9d-0248-44d7-9d0b-2d485de3d51c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:18.947635 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a488ec9d-0248-44d7-9d0b-2d485de3d51c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:18.948435 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a488ec9d-0248-44d7-9d0b-2d485de3d51c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:18.948891 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a488ec9d-0248-44d7-9d0b-2d485de3d51c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:19.016593 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a488ec9d-0248-44d7-9d0b-2d485de3d51c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:19.024505 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a488ec9d-0248-44d7-9d0b-2d485de3d51c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1244 microversion: 2.1 time: 0.089047 May 26 14:00:19.025071 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 279/516] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:18 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:19.109334 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-47f7bb8b-21d3-4e0d-a21a-d24a7f39dec7 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:19.109949 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-47f7bb8b-21d3-4e0d-a21a-d24a7f39dec7 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:19.116610 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-47f7bb8b-21d3-4e0d-a21a-d24a7f39dec7 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:19.117062 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-47f7bb8b-21d3-4e0d-a21a-d24a7f39dec7 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:19.118089 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-47f7bb8b-21d3-4e0d-a21a-d24a7f39dec7 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:19.118529 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-47f7bb8b-21d3-4e0d-a21a-d24a7f39dec7 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:19.250626 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-47f7bb8b-21d3-4e0d-a21a-d24a7f39dec7 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:19.258065 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-47f7bb8b-21d3-4e0d-a21a-d24a7f39dec7 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1271 microversion: 2.1 time: 0.152508 May 26 14:00:19.258626 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 238/517] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:19 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1271 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:19.311239 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-22cf405b-1883-467a-a09d-211591fb251c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:19.311849 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-22cf405b-1883-467a-a09d-211591fb251c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:19.317934 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-22cf405b-1883-467a-a09d-211591fb251c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:19.318386 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-22cf405b-1883-467a-a09d-211591fb251c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:19.319145 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-22cf405b-1883-467a-a09d-211591fb251c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:19.319581 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-22cf405b-1883-467a-a09d-211591fb251c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:19.443710 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-22cf405b-1883-467a-a09d-211591fb251c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:19.451570 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-22cf405b-1883-467a-a09d-211591fb251c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:19.453077 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-22cf405b-1883-467a-a09d-211591fb251c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:19.454240 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-22cf405b-1883-467a-a09d-211591fb251c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1724 microversion: 2.20 time: 0.146868 May 26 14:00:19.454799 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 280/518] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:19 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:00:19.560486 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b870e6d3-90a2-4232-b62a-a9aa009a75be tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:19.561089 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b870e6d3-90a2-4232-b62a-a9aa009a75be tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:19.567082 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b870e6d3-90a2-4232-b62a-a9aa009a75be tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:19.567530 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b870e6d3-90a2-4232-b62a-a9aa009a75be tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:19.568291 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b870e6d3-90a2-4232-b62a-a9aa009a75be tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:19.568725 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b870e6d3-90a2-4232-b62a-a9aa009a75be tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:19.699511 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b870e6d3-90a2-4232-b62a-a9aa009a75be tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:19.708065 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b870e6d3-90a2-4232-b62a-a9aa009a75be tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.152090 May 26 14:00:19.708678 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 239/519] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:19 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:20.041057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1bd67d4f-c6d6-4501-8c9d-e8a96de236ec tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:20.041756 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1bd67d4f-c6d6-4501-8c9d-e8a96de236ec tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:20.048527 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1bd67d4f-c6d6-4501-8c9d-e8a96de236ec tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:20.048969 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1bd67d4f-c6d6-4501-8c9d-e8a96de236ec tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:20.049793 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1bd67d4f-c6d6-4501-8c9d-e8a96de236ec tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:20.050226 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1bd67d4f-c6d6-4501-8c9d-e8a96de236ec tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:20.109329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1bd67d4f-c6d6-4501-8c9d-e8a96de236ec tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:20.116751 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1bd67d4f-c6d6-4501-8c9d-e8a96de236ec tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1244 microversion: 2.1 time: 0.079468 May 26 14:00:20.117356 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 281/520] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:20 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1244 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:20.274972 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-badc6d61-57eb-4c51-9c43-e16947e201f8 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:20.276122 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-badc6d61-57eb-4c51-9c43-e16947e201f8 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:20.277990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=4 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:20.278624 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=12 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:20.285340 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-badc6d61-57eb-4c51-9c43-e16947e201f8 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:20.285785 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-badc6d61-57eb-4c51-9c43-e16947e201f8 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:20.286557 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-badc6d61-57eb-4c51-9c43-e16947e201f8 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:20.286984 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-badc6d61-57eb-4c51-9c43-e16947e201f8 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:20.450126 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-badc6d61-57eb-4c51-9c43-e16947e201f8 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:20.458459 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-badc6d61-57eb-4c51-9c43-e16947e201f8 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1271 microversion: 2.1 time: 0.187482 May 26 14:00:20.462884 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 240/521] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:20 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1271 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:20.472577 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-32bd1793-e46e-4b98-973c-7f22e07af4c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:20.473587 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-32bd1793-e46e-4b98-973c-7f22e07af4c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:20.479601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-32bd1793-e46e-4b98-973c-7f22e07af4c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:20.480061 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-32bd1793-e46e-4b98-973c-7f22e07af4c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:20.480842 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-32bd1793-e46e-4b98-973c-7f22e07af4c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:20.481392 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-32bd1793-e46e-4b98-973c-7f22e07af4c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:20.621402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-32bd1793-e46e-4b98-973c-7f22e07af4c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:20.630335 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-32bd1793-e46e-4b98-973c-7f22e07af4c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:20.631667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-32bd1793-e46e-4b98-973c-7f22e07af4c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:20.632779 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-32bd1793-e46e-4b98-973c-7f22e07af4c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1724 microversion: 2.20 time: 0.164855 May 26 14:00:20.633480 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 282/522] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:20 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:00:20.725021 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a7e388c0-8a4e-4004-b8a4-2ea26a6032f9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:20.725675 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a7e388c0-8a4e-4004-b8a4-2ea26a6032f9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:20.727520 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:20.733798 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a7e388c0-8a4e-4004-b8a4-2ea26a6032f9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:20.734246 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a7e388c0-8a4e-4004-b8a4-2ea26a6032f9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:20.735007 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a7e388c0-8a4e-4004-b8a4-2ea26a6032f9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:20.735440 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a7e388c0-8a4e-4004-b8a4-2ea26a6032f9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:20.894682 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a7e388c0-8a4e-4004-b8a4-2ea26a6032f9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:20.902671 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a7e388c0-8a4e-4004-b8a4-2ea26a6032f9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.181559 May 26 14:00:20.903238 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 241/523] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:20 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:21.137494 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cc408384-9e25-42c6-8487-8b20f2d1b6e6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:21.139178 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-cc408384-9e25-42c6-8487-8b20f2d1b6e6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:21.146763 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cc408384-9e25-42c6-8487-8b20f2d1b6e6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:21.147497 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cc408384-9e25-42c6-8487-8b20f2d1b6e6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:21.150460 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cc408384-9e25-42c6-8487-8b20f2d1b6e6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:21.151327 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cc408384-9e25-42c6-8487-8b20f2d1b6e6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:21.240932 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cc408384-9e25-42c6-8487-8b20f2d1b6e6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:21.251770 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-cc408384-9e25-42c6-8487-8b20f2d1b6e6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1244 microversion: 2.1 time: 0.120082 May 26 14:00:21.252589 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 283/524] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:21 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1244 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:00:21.475754 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-679f3bc0-4fd4-4c99-9d98-48226ecbdb01 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:21.476370 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-679f3bc0-4fd4-4c99-9d98-48226ecbdb01 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:21.482958 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-679f3bc0-4fd4-4c99-9d98-48226ecbdb01 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:21.483404 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-679f3bc0-4fd4-4c99-9d98-48226ecbdb01 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:21.484242 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-679f3bc0-4fd4-4c99-9d98-48226ecbdb01 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:21.484850 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-679f3bc0-4fd4-4c99-9d98-48226ecbdb01 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:21.487600 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:21.619435 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-679f3bc0-4fd4-4c99-9d98-48226ecbdb01 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:21.628283 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-679f3bc0-4fd4-4c99-9d98-48226ecbdb01 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1271 microversion: 2.1 time: 0.156122 May 26 14:00:21.629669 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 242/525] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:21 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:21.653433 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cb9ac486-be4e-4992-be27-b3c00d14ef33 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:21.654627 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-cb9ac486-be4e-4992-be27-b3c00d14ef33 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:21.661129 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cb9ac486-be4e-4992-be27-b3c00d14ef33 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:21.663016 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cb9ac486-be4e-4992-be27-b3c00d14ef33 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:21.664005 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cb9ac486-be4e-4992-be27-b3c00d14ef33 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:21.664600 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cb9ac486-be4e-4992-be27-b3c00d14ef33 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:21.816316 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cb9ac486-be4e-4992-be27-b3c00d14ef33 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:21.825595 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cb9ac486-be4e-4992-be27-b3c00d14ef33 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:21.827110 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cb9ac486-be4e-4992-be27-b3c00d14ef33 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:21.828267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-cb9ac486-be4e-4992-be27-b3c00d14ef33 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1724 microversion: 2.20 time: 0.179895 May 26 14:00:21.828936 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 284/526] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:21 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:21.923713 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e81df679-3384-4924-9db3-95aca15a2aa2 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:21.924303 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e81df679-3384-4924-9db3-95aca15a2aa2 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:21.932193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e81df679-3384-4924-9db3-95aca15a2aa2 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:21.932806 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e81df679-3384-4924-9db3-95aca15a2aa2 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:21.934011 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e81df679-3384-4924-9db3-95aca15a2aa2 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:21.934678 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e81df679-3384-4924-9db3-95aca15a2aa2 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:22.125382 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e81df679-3384-4924-9db3-95aca15a2aa2 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:22.135705 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e81df679-3384-4924-9db3-95aca15a2aa2 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.215702 May 26 14:00:22.136968 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 243/527] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:21 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:22.275504 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4e21e53b-974d-4e97-8fbe-62004ea86a4a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:22.275504 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4e21e53b-974d-4e97-8fbe-62004ea86a4a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:22.294455 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4e21e53b-974d-4e97-8fbe-62004ea86a4a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:22.294947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4e21e53b-974d-4e97-8fbe-62004ea86a4a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:22.295767 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4e21e53b-974d-4e97-8fbe-62004ea86a4a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:22.296223 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4e21e53b-974d-4e97-8fbe-62004ea86a4a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:22.430812 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4e21e53b-974d-4e97-8fbe-62004ea86a4a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:22.440170 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4e21e53b-974d-4e97-8fbe-62004ea86a4a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1244 microversion: 2.1 time: 0.170642 May 26 14:00:22.441464 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 285/528] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:22 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1244 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:22.648023 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b886a86d-f350-45e0-a34c-2250785dfe9a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:22.649409 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b886a86d-f350-45e0-a34c-2250785dfe9a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:22.658455 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b886a86d-f350-45e0-a34c-2250785dfe9a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:22.659559 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b886a86d-f350-45e0-a34c-2250785dfe9a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:22.659906 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b886a86d-f350-45e0-a34c-2250785dfe9a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:22.660842 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b886a86d-f350-45e0-a34c-2250785dfe9a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:22.849070 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5602a169-0f61-4983-b7ba-e45d50c670e9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:22.850310 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5602a169-0f61-4983-b7ba-e45d50c670e9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:22.858237 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5602a169-0f61-4983-b7ba-e45d50c670e9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:22.859087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5602a169-0f61-4983-b7ba-e45d50c670e9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:22.860225 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5602a169-0f61-4983-b7ba-e45d50c670e9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:22.860921 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5602a169-0f61-4983-b7ba-e45d50c670e9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:22.883403 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b886a86d-f350-45e0-a34c-2250785dfe9a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:22.892988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b886a86d-f350-45e0-a34c-2250785dfe9a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1271 microversion: 2.1 time: 0.250159 May 26 14:00:22.893991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 244/529] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:22 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1271 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:23.042982 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5602a169-0f61-4983-b7ba-e45d50c670e9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:23.057868 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5602a169-0f61-4983-b7ba-e45d50c670e9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:23.061506 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5602a169-0f61-4983-b7ba-e45d50c670e9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:23.063568 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5602a169-0f61-4983-b7ba-e45d50c670e9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1724 microversion: 2.20 time: 0.218158 May 26 14:00:23.065605 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 286/530] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:22 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:23.157648 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-50bd0863-69d1-4bdc-a73a-6e1230d4551f tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:23.158503 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-50bd0863-69d1-4bdc-a73a-6e1230d4551f tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:23.171272 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-50bd0863-69d1-4bdc-a73a-6e1230d4551f tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:23.172875 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-50bd0863-69d1-4bdc-a73a-6e1230d4551f tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:23.173937 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-50bd0863-69d1-4bdc-a73a-6e1230d4551f tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:23.177127 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-50bd0863-69d1-4bdc-a73a-6e1230d4551f tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:23.369236 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-50bd0863-69d1-4bdc-a73a-6e1230d4551f tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:23.378010 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-50bd0863-69d1-4bdc-a73a-6e1230d4551f tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.227316 May 26 14:00:23.424344 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 245/531] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:23 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:23.468946 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-61c87402-71f0-46d1-8153-eec3fc4ee49b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:23.470179 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-61c87402-71f0-46d1-8153-eec3fc4ee49b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:23.484987 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:23.487215 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=20 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:23.489403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-61c87402-71f0-46d1-8153-eec3fc4ee49b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:23.490038 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-61c87402-71f0-46d1-8153-eec3fc4ee49b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:23.490994 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-61c87402-71f0-46d1-8153-eec3fc4ee49b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:23.491578 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-61c87402-71f0-46d1-8153-eec3fc4ee49b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:23.581760 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-61c87402-71f0-46d1-8153-eec3fc4ee49b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:23.612959 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-61c87402-71f0-46d1-8153-eec3fc4ee49b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1244 microversion: 2.1 time: 0.159262 May 26 14:00:23.616788 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 287/532] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:23 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1244 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:23.910031 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d39cd15b-ee3f-431b-b654-919e66406b7e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:23.911386 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d39cd15b-ee3f-431b-b654-919e66406b7e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:23.918182 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d39cd15b-ee3f-431b-b654-919e66406b7e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:23.918685 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d39cd15b-ee3f-431b-b654-919e66406b7e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:23.919491 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d39cd15b-ee3f-431b-b654-919e66406b7e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:23.919921 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d39cd15b-ee3f-431b-b654-919e66406b7e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:24.071317 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d39cd15b-ee3f-431b-b654-919e66406b7e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:24.085824 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d39cd15b-ee3f-431b-b654-919e66406b7e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1271 microversion: 2.1 time: 0.179540 May 26 14:00:24.088985 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-45a5d1b1-cbb6-4536-9ff8-9ee323acfb01 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:24.090466 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-45a5d1b1-cbb6-4536-9ff8-9ee323acfb01 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:24.095693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 246/533] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:23 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1271 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:24.110235 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-45a5d1b1-cbb6-4536-9ff8-9ee323acfb01 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:24.112529 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-45a5d1b1-cbb6-4536-9ff8-9ee323acfb01 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:24.115204 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-45a5d1b1-cbb6-4536-9ff8-9ee323acfb01 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:24.117102 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-45a5d1b1-cbb6-4536-9ff8-9ee323acfb01 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:24.312796 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-45a5d1b1-cbb6-4536-9ff8-9ee323acfb01 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:24.331443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-45a5d1b1-cbb6-4536-9ff8-9ee323acfb01 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:24.334084 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-45a5d1b1-cbb6-4536-9ff8-9ee323acfb01 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:24.336014 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-45a5d1b1-cbb6-4536-9ff8-9ee323acfb01 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1724 microversion: 2.20 time: 0.253531 May 26 14:00:24.337007 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 288/534] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:24 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:00:24.484591 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f485d3e1-054e-451d-be57-843c8a72db49 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:24.485358 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f485d3e1-054e-451d-be57-843c8a72db49 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:24.492358 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f485d3e1-054e-451d-be57-843c8a72db49 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:24.492805 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f485d3e1-054e-451d-be57-843c8a72db49 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:24.494129 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f485d3e1-054e-451d-be57-843c8a72db49 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:24.494575 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f485d3e1-054e-451d-be57-843c8a72db49 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:24.634128 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-dcf049fb-d225-46c2-9066-c825d4e8ffc0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:24.635566 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-dcf049fb-d225-46c2-9066-c825d4e8ffc0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:24.652126 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dcf049fb-d225-46c2-9066-c825d4e8ffc0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:24.652844 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dcf049fb-d225-46c2-9066-c825d4e8ffc0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:24.661963 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dcf049fb-d225-46c2-9066-c825d4e8ffc0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:24.662417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dcf049fb-d225-46c2-9066-c825d4e8ffc0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:24.736212 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-dcf049fb-d225-46c2-9066-c825d4e8ffc0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:24.738118 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f485d3e1-054e-451d-be57-843c8a72db49 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:24.747353 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f485d3e1-054e-451d-be57-843c8a72db49 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.266768 May 26 14:00:24.748122 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 247/535] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:24 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:24.748557 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-dcf049fb-d225-46c2-9066-c825d4e8ffc0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1244 microversion: 2.1 time: 0.118201 May 26 14:00:24.749119 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 289/536] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:24 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1244 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:25.103782 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-932de0f6-bafd-4174-8503-57d2f5a6650e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:25.104506 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-932de0f6-bafd-4174-8503-57d2f5a6650e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:25.120395 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-932de0f6-bafd-4174-8503-57d2f5a6650e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:25.121078 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-932de0f6-bafd-4174-8503-57d2f5a6650e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:25.123033 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-932de0f6-bafd-4174-8503-57d2f5a6650e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:25.123718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-932de0f6-bafd-4174-8503-57d2f5a6650e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:25.311100 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-932de0f6-bafd-4174-8503-57d2f5a6650e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:25.319246 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-932de0f6-bafd-4174-8503-57d2f5a6650e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1271 microversion: 2.1 time: 0.220031 May 26 14:00:25.320598 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 248/537] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:25 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1271 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:25.356982 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-160b142e-75d6-4030-ae7d-e09b5b882b59 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:25.357524 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-160b142e-75d6-4030-ae7d-e09b5b882b59 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:25.364226 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-160b142e-75d6-4030-ae7d-e09b5b882b59 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:25.364674 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-160b142e-75d6-4030-ae7d-e09b5b882b59 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:25.365488 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-160b142e-75d6-4030-ae7d-e09b5b882b59 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:25.365929 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-160b142e-75d6-4030-ae7d-e09b5b882b59 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:25.504967 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-160b142e-75d6-4030-ae7d-e09b5b882b59 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:25.507181 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:25.514963 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-160b142e-75d6-4030-ae7d-e09b5b882b59 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:25.516497 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-160b142e-75d6-4030-ae7d-e09b5b882b59 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:25.517685 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-160b142e-75d6-4030-ae7d-e09b5b882b59 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1724 microversion: 2.20 time: 0.164693 May 26 14:00:25.518527 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 290/538] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:25 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:25.764162 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-194f2510-9c32-4b60-ab26-ffc6d0223475 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:25.765121 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-194f2510-9c32-4b60-ab26-ffc6d0223475 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:25.766602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9a507529-9b10-4cb2-aa90-acf968cde52e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:25.767520 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9a507529-9b10-4cb2-aa90-acf968cde52e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:25.774395 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-194f2510-9c32-4b60-ab26-ffc6d0223475 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:25.775328 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-194f2510-9c32-4b60-ab26-ffc6d0223475 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:25.776031 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-194f2510-9c32-4b60-ab26-ffc6d0223475 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:25.776656 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-194f2510-9c32-4b60-ab26-ffc6d0223475 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:25.782901 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a507529-9b10-4cb2-aa90-acf968cde52e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:25.783364 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a507529-9b10-4cb2-aa90-acf968cde52e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:25.784309 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a507529-9b10-4cb2-aa90-acf968cde52e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:25.784946 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a507529-9b10-4cb2-aa90-acf968cde52e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:25.918773 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9a507529-9b10-4cb2-aa90-acf968cde52e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:25.930239 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9a507529-9b10-4cb2-aa90-acf968cde52e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1244 microversion: 2.1 time: 0.167391 May 26 14:00:25.930826 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 291/539] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:25 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1244 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:26.005800 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-194f2510-9c32-4b60-ab26-ffc6d0223475 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:26.014646 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-194f2510-9c32-4b60-ab26-ffc6d0223475 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.254557 May 26 14:00:26.030086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 249/540] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:25 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:26.338403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-433a8455-eaf1-4c49-8720-b07ae709c337 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:26.339483 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-433a8455-eaf1-4c49-8720-b07ae709c337 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:26.346302 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-433a8455-eaf1-4c49-8720-b07ae709c337 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:26.347038 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-433a8455-eaf1-4c49-8720-b07ae709c337 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:26.348063 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-433a8455-eaf1-4c49-8720-b07ae709c337 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:26.348735 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-433a8455-eaf1-4c49-8720-b07ae709c337 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:26.520826 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-433a8455-eaf1-4c49-8720-b07ae709c337 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:26.530251 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-433a8455-eaf1-4c49-8720-b07ae709c337 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1271 microversion: 2.1 time: 0.196375 May 26 14:00:26.532584 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 292/541] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:26 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1271 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:26.537059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-43785a35-a039-44be-9aa3-8b3d85e245a0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:26.538417 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-43785a35-a039-44be-9aa3-8b3d85e245a0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:26.546963 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43785a35-a039-44be-9aa3-8b3d85e245a0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:26.553595 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43785a35-a039-44be-9aa3-8b3d85e245a0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:26.554548 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43785a35-a039-44be-9aa3-8b3d85e245a0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:26.555077 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43785a35-a039-44be-9aa3-8b3d85e245a0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:26.732199 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-43785a35-a039-44be-9aa3-8b3d85e245a0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:26.742009 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-43785a35-a039-44be-9aa3-8b3d85e245a0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:26.753382 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-43785a35-a039-44be-9aa3-8b3d85e245a0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:26.756616 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-43785a35-a039-44be-9aa3-8b3d85e245a0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1724 microversion: 2.20 time: 0.224285 May 26 14:00:26.765623 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 250/542] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:26 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:00:26.947693 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-36425b98-d2fe-402b-ae6f-057cfdc25c3f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:26.948925 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-36425b98-d2fe-402b-ae6f-057cfdc25c3f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:26.959526 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-36425b98-d2fe-402b-ae6f-057cfdc25c3f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:26.961419 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-36425b98-d2fe-402b-ae6f-057cfdc25c3f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:26.962942 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-36425b98-d2fe-402b-ae6f-057cfdc25c3f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:26.963689 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-36425b98-d2fe-402b-ae6f-057cfdc25c3f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:27.035865 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-531417ca-ede2-4bde-9e1d-0cf2e38b7fb9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:27.036749 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-531417ca-ede2-4bde-9e1d-0cf2e38b7fb9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:27.044048 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-531417ca-ede2-4bde-9e1d-0cf2e38b7fb9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:27.044742 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-531417ca-ede2-4bde-9e1d-0cf2e38b7fb9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:27.045901 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-531417ca-ede2-4bde-9e1d-0cf2e38b7fb9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:27.075176 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-36425b98-d2fe-402b-ae6f-057cfdc25c3f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:27.088640 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-531417ca-ede2-4bde-9e1d-0cf2e38b7fb9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:27.148941 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-36425b98-d2fe-402b-ae6f-057cfdc25c3f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1244 microversion: 2.1 time: 0.205070 May 26 14:00:27.213049 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 293/543] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:26 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1244 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:27.408946 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-531417ca-ede2-4bde-9e1d-0cf2e38b7fb9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:27.420072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-531417ca-ede2-4bde-9e1d-0cf2e38b7fb9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.388113 May 26 14:00:27.421207 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 251/544] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:27 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:27.549432 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8cc3a2aa-86f2-4ca8-b326-ce7323298140 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:27.550320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8cc3a2aa-86f2-4ca8-b326-ce7323298140 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:27.558042 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8cc3a2aa-86f2-4ca8-b326-ce7323298140 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:27.558494 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8cc3a2aa-86f2-4ca8-b326-ce7323298140 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:27.559266 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8cc3a2aa-86f2-4ca8-b326-ce7323298140 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:27.559730 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8cc3a2aa-86f2-4ca8-b326-ce7323298140 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:27.716298 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8cc3a2aa-86f2-4ca8-b326-ce7323298140 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:27.724276 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8cc3a2aa-86f2-4ca8-b326-ce7323298140 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1271 microversion: 2.1 time: 0.178794 May 26 14:00:27.725870 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 294/545] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:27 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1271 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:27.788167 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8c599f11-eaed-441a-97c7-477ad390b4a6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:27.789813 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8c599f11-eaed-441a-97c7-477ad390b4a6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:27.799348 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8c599f11-eaed-441a-97c7-477ad390b4a6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:27.800118 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8c599f11-eaed-441a-97c7-477ad390b4a6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:27.801104 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8c599f11-eaed-441a-97c7-477ad390b4a6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:27.801739 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8c599f11-eaed-441a-97c7-477ad390b4a6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:27.968033 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8c599f11-eaed-441a-97c7-477ad390b4a6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:27.976928 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8c599f11-eaed-441a-97c7-477ad390b4a6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:27.978567 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8c599f11-eaed-441a-97c7-477ad390b4a6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:27.979748 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8c599f11-eaed-441a-97c7-477ad390b4a6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1724 microversion: 2.20 time: 0.196099 May 26 14:00:27.980325 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 252/546] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:27 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:28.166930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-80701bb2-6479-4da8-8a0c-3642e764599a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:28.168290 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-80701bb2-6479-4da8-8a0c-3642e764599a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:28.175787 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-80701bb2-6479-4da8-8a0c-3642e764599a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:28.176552 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-80701bb2-6479-4da8-8a0c-3642e764599a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:28.177621 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-80701bb2-6479-4da8-8a0c-3642e764599a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:28.178279 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-80701bb2-6479-4da8-8a0c-3642e764599a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:28.248778 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-80701bb2-6479-4da8-8a0c-3642e764599a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:28.260435 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-80701bb2-6479-4da8-8a0c-3642e764599a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1244 microversion: 2.1 time: 0.097175 May 26 14:00:28.261630 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 295/547] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:28 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1244 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:28.440631 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f4a05a27-ba45-4bd4-b4b3-56aa8f86aff2 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:28.441815 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f4a05a27-ba45-4bd4-b4b3-56aa8f86aff2 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:28.449562 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4a05a27-ba45-4bd4-b4b3-56aa8f86aff2 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:28.450290 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4a05a27-ba45-4bd4-b4b3-56aa8f86aff2 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:28.451439 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4a05a27-ba45-4bd4-b4b3-56aa8f86aff2 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:28.451945 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4a05a27-ba45-4bd4-b4b3-56aa8f86aff2 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:28.592187 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f4a05a27-ba45-4bd4-b4b3-56aa8f86aff2 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:28.600016 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f4a05a27-ba45-4bd4-b4b3-56aa8f86aff2 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.163139 May 26 14:00:28.600959 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 253/548] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:28 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:28.744327 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8564ab6d-5a36-4978-af6a-3205c2976ddd tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:28.745137 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8564ab6d-5a36-4978-af6a-3205c2976ddd tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:28.753078 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8564ab6d-5a36-4978-af6a-3205c2976ddd tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:28.754090 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8564ab6d-5a36-4978-af6a-3205c2976ddd tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:28.755596 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8564ab6d-5a36-4978-af6a-3205c2976ddd tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:28.756124 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8564ab6d-5a36-4978-af6a-3205c2976ddd tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:28.941428 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8564ab6d-5a36-4978-af6a-3205c2976ddd tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:28.951131 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8564ab6d-5a36-4978-af6a-3205c2976ddd tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1271 microversion: 2.1 time: 0.212096 May 26 14:00:28.952161 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 296/549] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:28 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1271 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:28.999015 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0925ac0a-857a-42ce-a127-1e97676b26b8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:29.000387 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0925ac0a-857a-42ce-a127-1e97676b26b8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:29.007949 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0925ac0a-857a-42ce-a127-1e97676b26b8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:29.008718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0925ac0a-857a-42ce-a127-1e97676b26b8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:29.009618 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0925ac0a-857a-42ce-a127-1e97676b26b8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:29.010310 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0925ac0a-857a-42ce-a127-1e97676b26b8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:29.198274 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0925ac0a-857a-42ce-a127-1e97676b26b8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:29.208306 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0925ac0a-857a-42ce-a127-1e97676b26b8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:29.209847 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0925ac0a-857a-42ce-a127-1e97676b26b8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:29.211046 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0925ac0a-857a-42ce-a127-1e97676b26b8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1724 microversion: 2.20 time: 0.216063 May 26 14:00:29.212762 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 254/550] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:28 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:29.279322 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7af7656a-4b67-4786-af10-bcdaad0897d5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:29.281868 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7af7656a-4b67-4786-af10-bcdaad0897d5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:29.291691 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7af7656a-4b67-4786-af10-bcdaad0897d5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:29.292286 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7af7656a-4b67-4786-af10-bcdaad0897d5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:29.293287 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7af7656a-4b67-4786-af10-bcdaad0897d5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:29.293724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7af7656a-4b67-4786-af10-bcdaad0897d5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:29.373188 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7af7656a-4b67-4786-af10-bcdaad0897d5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:29.381313 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7af7656a-4b67-4786-af10-bcdaad0897d5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1244 microversion: 2.1 time: 0.107290 May 26 14:00:29.382120 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 297/551] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:29 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1244 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:29.622477 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0c9ed844-8c59-442c-a881-05366d99d940 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:29.623206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0c9ed844-8c59-442c-a881-05366d99d940 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:29.629917 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0c9ed844-8c59-442c-a881-05366d99d940 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:29.630373 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0c9ed844-8c59-442c-a881-05366d99d940 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:29.631182 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0c9ed844-8c59-442c-a881-05366d99d940 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:29.631641 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0c9ed844-8c59-442c-a881-05366d99d940 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:29.799948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0c9ed844-8c59-442c-a881-05366d99d940 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:29.808467 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0c9ed844-8c59-442c-a881-05366d99d940 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.190354 May 26 14:00:29.810244 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 255/552] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:29 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:29.968598 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a44ae0a9-d1c5-4edc-aff7-0ad6b4fb3b2b tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:29.969244 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a44ae0a9-d1c5-4edc-aff7-0ad6b4fb3b2b tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:29.975671 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a44ae0a9-d1c5-4edc-aff7-0ad6b4fb3b2b tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:29.976116 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a44ae0a9-d1c5-4edc-aff7-0ad6b4fb3b2b tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:29.976888 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a44ae0a9-d1c5-4edc-aff7-0ad6b4fb3b2b tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:29.977370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a44ae0a9-d1c5-4edc-aff7-0ad6b4fb3b2b tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:30.115853 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a44ae0a9-d1c5-4edc-aff7-0ad6b4fb3b2b tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:30.127287 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a44ae0a9-d1c5-4edc-aff7-0ad6b4fb3b2b tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1271 microversion: 2.1 time: 0.163130 May 26 14:00:30.128534 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 298/553] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:29 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:30.231988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f282cdb3-8969-47c4-8ba5-7b5fcbc2a1d2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:30.233563 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f282cdb3-8969-47c4-8ba5-7b5fcbc2a1d2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:30.243868 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f282cdb3-8969-47c4-8ba5-7b5fcbc2a1d2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:30.244833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f282cdb3-8969-47c4-8ba5-7b5fcbc2a1d2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:30.246478 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f282cdb3-8969-47c4-8ba5-7b5fcbc2a1d2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:30.247294 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f282cdb3-8969-47c4-8ba5-7b5fcbc2a1d2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:30.398674 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ce5bb831-eecd-4dd5-9c73-d08484e77c42 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:30.399970 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ce5bb831-eecd-4dd5-9c73-d08484e77c42 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:30.410498 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ce5bb831-eecd-4dd5-9c73-d08484e77c42 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:30.410948 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ce5bb831-eecd-4dd5-9c73-d08484e77c42 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:30.411767 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ce5bb831-eecd-4dd5-9c73-d08484e77c42 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:30.412204 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ce5bb831-eecd-4dd5-9c73-d08484e77c42 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:30.438641 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f282cdb3-8969-47c4-8ba5-7b5fcbc2a1d2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:30.450614 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f282cdb3-8969-47c4-8ba5-7b5fcbc2a1d2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:30.452558 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f282cdb3-8969-47c4-8ba5-7b5fcbc2a1d2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:30.454058 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f282cdb3-8969-47c4-8ba5-7b5fcbc2a1d2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1724 microversion: 2.20 time: 0.227431 May 26 14:00:30.466440 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 256/554] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:30 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:30.531226 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ce5bb831-eecd-4dd5-9c73-d08484e77c42 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:30.564195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ce5bb831-eecd-4dd5-9c73-d08484e77c42 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1244 microversion: 2.1 time: 0.168542 May 26 14:00:30.575621 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 299/555] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:30 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1244 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:30.833063 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b250aa30-c714-4995-b86a-c81844575745 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:30.838825 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b250aa30-c714-4995-b86a-c81844575745 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:30.845558 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b250aa30-c714-4995-b86a-c81844575745 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:30.846019 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b250aa30-c714-4995-b86a-c81844575745 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:30.847176 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b250aa30-c714-4995-b86a-c81844575745 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:30.847617 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b250aa30-c714-4995-b86a-c81844575745 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:31.144907 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-470a8d6d-631f-402f-b13c-249eea2779d3 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:31.145780 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-470a8d6d-631f-402f-b13c-249eea2779d3 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:31.161903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-470a8d6d-631f-402f-b13c-249eea2779d3 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:31.167324 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-470a8d6d-631f-402f-b13c-249eea2779d3 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:31.168254 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-470a8d6d-631f-402f-b13c-249eea2779d3 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:31.168944 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-470a8d6d-631f-402f-b13c-249eea2779d3 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:31.291076 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b250aa30-c714-4995-b86a-c81844575745 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:31.301927 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b250aa30-c714-4995-b86a-c81844575745 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.477241 May 26 14:00:31.302934 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 257/556] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:30 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:31.474194 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dc81aae4-f58b-4bf6-9366-377300647f9a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:31.475022 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-dc81aae4-f58b-4bf6-9366-377300647f9a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:31.490930 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dc81aae4-f58b-4bf6-9366-377300647f9a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:31.491513 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dc81aae4-f58b-4bf6-9366-377300647f9a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:31.492581 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dc81aae4-f58b-4bf6-9366-377300647f9a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:31.493117 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dc81aae4-f58b-4bf6-9366-377300647f9a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:31.869194 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-470a8d6d-631f-402f-b13c-249eea2779d3 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:31.878904 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-470a8d6d-631f-402f-b13c-249eea2779d3 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1259 microversion: 2.1 time: 0.738694 May 26 14:00:31.879901 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 300/557] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:31 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1259 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:31.886458 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-73575580-46b7-4de3-bfbc-a28de466a00e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:31.887363 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-73575580-46b7-4de3-bfbc-a28de466a00e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:31.893653 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-73575580-46b7-4de3-bfbc-a28de466a00e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:31.894390 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-73575580-46b7-4de3-bfbc-a28de466a00e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:31.895381 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-73575580-46b7-4de3-bfbc-a28de466a00e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:31.896021 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-73575580-46b7-4de3-bfbc-a28de466a00e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:32.064407 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dc81aae4-f58b-4bf6-9366-377300647f9a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:32.073477 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:32.080806 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dc81aae4-f58b-4bf6-9366-377300647f9a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:32.082591 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-73575580-46b7-4de3-bfbc-a28de466a00e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:32.088900 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dc81aae4-f58b-4bf6-9366-377300647f9a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:32.090909 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dc81aae4-f58b-4bf6-9366-377300647f9a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1724 microversion: 2.20 time: 0.621614 May 26 14:00:32.092143 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 258/558] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:31 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1724 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:32.111266 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-73575580-46b7-4de3-bfbc-a28de466a00e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1310 microversion: 2.1 time: 0.228897 May 26 14:00:32.112104 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 301/559] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:31 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1310 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:32.326553 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b67715f9-5862-4425-900d-2c2092674390 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:32.327161 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b67715f9-5862-4425-900d-2c2092674390 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:32.335868 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b67715f9-5862-4425-900d-2c2092674390 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:32.336321 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b67715f9-5862-4425-900d-2c2092674390 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:32.337133 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b67715f9-5862-4425-900d-2c2092674390 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:32.337591 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b67715f9-5862-4425-900d-2c2092674390 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:32.658706 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-64c70c16-72a3-44d7-a5c1-e23f4faf56b0 req-178065bd-06ed-4863-b35f-52cfa811ce48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4176fdc7-3ccd-4093-b4c4-841eafb524f7", "tag": "7d604ff9-6337-4905-bd16-e0eb02d19035"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:00:32.675399 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-64c70c16-72a3-44d7-a5c1-e23f4faf56b0 req-178065bd-06ed-4863-b35f-52cfa811ce48 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:32.675990 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-64c70c16-72a3-44d7-a5c1-e23f4faf56b0 req-178065bd-06ed-4863-b35f-52cfa811ce48 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:32.689334 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-64c70c16-72a3-44d7-a5c1-e23f4faf56b0 req-178065bd-06ed-4863-b35f-52cfa811ce48 service nova] Creating event network-changed:7d604ff9-6337-4905-bd16-e0eb02d19035 for instance 4176fdc7-3ccd-4093-b4c4-841eafb524f7 on hv-cinder-84213 May 26 14:00:32.698032 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-64c70c16-72a3-44d7-a5c1-e23f4faf56b0 req-178065bd-06ed-4863-b35f-52cfa811ce48 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043239 May 26 14:00:32.699434 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 302/560] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:00:32.776973 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b67715f9-5862-4425-900d-2c2092674390 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:32.785103 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b67715f9-5862-4425-900d-2c2092674390 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.462206 May 26 14:00:32.789854 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 259/561] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:32 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:00:32.897231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-dd084ced-6ff0-4a72-ac35-64e6159f6c07 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:32.898146 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-dd084ced-6ff0-4a72-ac35-64e6159f6c07 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:32.919969 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd084ced-6ff0-4a72-ac35-64e6159f6c07 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:32.923087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd084ced-6ff0-4a72-ac35-64e6159f6c07 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:32.925301 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd084ced-6ff0-4a72-ac35-64e6159f6c07 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:32.929750 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd084ced-6ff0-4a72-ac35-64e6159f6c07 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:33.112555 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-df7d846a-0beb-4ec6-9cf8-1ddf90b5f5cd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:33.123432 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-df7d846a-0beb-4ec6-9cf8-1ddf90b5f5cd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:33.132991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-df7d846a-0beb-4ec6-9cf8-1ddf90b5f5cd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:33.137041 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-dd084ced-6ff0-4a72-ac35-64e6159f6c07 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:33.143087 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-df7d846a-0beb-4ec6-9cf8-1ddf90b5f5cd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:33.144735 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-df7d846a-0beb-4ec6-9cf8-1ddf90b5f5cd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:33.145254 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-df7d846a-0beb-4ec6-9cf8-1ddf90b5f5cd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:33.147002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-dd084ced-6ff0-4a72-ac35-64e6159f6c07 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1259 microversion: 2.1 time: 0.254134 May 26 14:00:33.148018 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 303/562] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:32 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1259 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:33.163118 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d23713f7-6173-4739-888f-afbc4474e82f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:33.163962 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d23713f7-6173-4739-888f-afbc4474e82f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:33.172305 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d23713f7-6173-4739-888f-afbc4474e82f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:33.172938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d23713f7-6173-4739-888f-afbc4474e82f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:33.173922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d23713f7-6173-4739-888f-afbc4474e82f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:33.182630 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d23713f7-6173-4739-888f-afbc4474e82f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:33.555598 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d23713f7-6173-4739-888f-afbc4474e82f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:33.565352 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d23713f7-6173-4739-888f-afbc4474e82f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1366 microversion: 2.1 time: 0.406229 May 26 14:00:33.572622 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 304/563] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:33 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1366 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:33.695289 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-df7d846a-0beb-4ec6-9cf8-1ddf90b5f5cd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:33.706768 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-df7d846a-0beb-4ec6-9cf8-1ddf90b5f5cd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:33.709758 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-df7d846a-0beb-4ec6-9cf8-1ddf90b5f5cd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:33.711283 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-df7d846a-0beb-4ec6-9cf8-1ddf90b5f5cd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1724 microversion: 2.20 time: 0.603069 May 26 14:00:33.713038 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 260/564] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:33 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1724 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:33.807959 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4bc5eff4-ab3b-402d-a56d-44a654319952 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:33.808619 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4bc5eff4-ab3b-402d-a56d-44a654319952 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:33.825032 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4bc5eff4-ab3b-402d-a56d-44a654319952 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:33.825449 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4bc5eff4-ab3b-402d-a56d-44a654319952 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:33.826246 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4bc5eff4-ab3b-402d-a56d-44a654319952 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:33.826681 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4bc5eff4-ab3b-402d-a56d-44a654319952 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:33.993985 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4bc5eff4-ab3b-402d-a56d-44a654319952 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:34.004309 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4bc5eff4-ab3b-402d-a56d-44a654319952 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.199979 May 26 14:00:34.005458 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 305/565] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:33 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:34.164239 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a9c6a61b-5b2f-4a5e-844e-465507bf84b2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:34.165037 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a9c6a61b-5b2f-4a5e-844e-465507bf84b2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:34.187642 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a9c6a61b-5b2f-4a5e-844e-465507bf84b2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:34.188349 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a9c6a61b-5b2f-4a5e-844e-465507bf84b2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:34.189326 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a9c6a61b-5b2f-4a5e-844e-465507bf84b2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:34.195207 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a9c6a61b-5b2f-4a5e-844e-465507bf84b2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:34.402206 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-663c559e-d2a6-425f-bf8f-2fa8be99acee req-f85c98e3-8d1b-49c8-aa38-400f10cc200c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40c8745d-a394-4026-a5c4-b5ce4c5590e0", "tag": "3d450e70-f1c7-407d-adbd-6d7812d913c3"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:00:34.421037 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-663c559e-d2a6-425f-bf8f-2fa8be99acee req-f85c98e3-8d1b-49c8-aa38-400f10cc200c service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:34.421527 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-663c559e-d2a6-425f-bf8f-2fa8be99acee req-f85c98e3-8d1b-49c8-aa38-400f10cc200c service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:34.445515 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-663c559e-d2a6-425f-bf8f-2fa8be99acee req-f85c98e3-8d1b-49c8-aa38-400f10cc200c service nova] Creating event network-changed:3d450e70-f1c7-407d-adbd-6d7812d913c3 for instance 40c8745d-a394-4026-a5c4-b5ce4c5590e0 on hv-cinder-84213 May 26 14:00:34.460375 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-663c559e-d2a6-425f-bf8f-2fa8be99acee req-f85c98e3-8d1b-49c8-aa38-400f10cc200c service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061711 May 26 14:00:34.465645 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 306/566] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:00:34.501104 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8db94f2a-44f7-4bd4-be96-f93fb13239c6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-124641946", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-886850747", "security_groups": [{"name": "tempest-secgroup-smoke-1274687408"}], "block_device_mapping_v2": [{"uuid": "01c79ff6-ce9e-4a3f-bbf7-9a1fc154dbf3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bb3bf56d-90fc-4a74-995d-ab2752db975c"}]}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:00:34.778402 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a9c6a61b-5b2f-4a5e-844e-465507bf84b2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:34.787803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a9c6a61b-5b2f-4a5e-844e-465507bf84b2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1259 microversion: 2.1 time: 0.627303 May 26 14:00:34.798607 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 261/567] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:34 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1259 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:34.804610 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ad1c456b-0b65-4621-a5e8-31469476c637 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:34.806754 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ad1c456b-0b65-4621-a5e8-31469476c637 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:34.815510 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ad1c456b-0b65-4621-a5e8-31469476c637 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:34.816085 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ad1c456b-0b65-4621-a5e8-31469476c637 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:34.817087 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ad1c456b-0b65-4621-a5e8-31469476c637 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:34.817753 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ad1c456b-0b65-4621-a5e8-31469476c637 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:34.846841 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-8db94f2a-44f7-4bd4-be96-f93fb13239c6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] validate_networks() for [('bb3bf56d-90fc-4a74-995d-ab2752db975c', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 14:00:35.100606 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ad1c456b-0b65-4621-a5e8-31469476c637 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:35.108905 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ad1c456b-0b65-4621-a5e8-31469476c637 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1366 microversion: 2.1 time: 0.308315 May 26 14:00:35.109632 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 262/568] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:34 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:35.114880 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-af8571a8-56ec-47ce-9e45-b77362e9d7e0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:35.115610 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-af8571a8-56ec-47ce-9e45-b77362e9d7e0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:35.122667 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-af8571a8-56ec-47ce-9e45-b77362e9d7e0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:35.123918 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-af8571a8-56ec-47ce-9e45-b77362e9d7e0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:35.124967 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-af8571a8-56ec-47ce-9e45-b77362e9d7e0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:35.125709 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-af8571a8-56ec-47ce-9e45-b77362e9d7e0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:35.369634 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-af8571a8-56ec-47ce-9e45-b77362e9d7e0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:35.378082 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-af8571a8-56ec-47ce-9e45-b77362e9d7e0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:35.379619 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-af8571a8-56ec-47ce-9e45-b77362e9d7e0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:35.380829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-af8571a8-56ec-47ce-9e45-b77362e9d7e0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1745 microversion: 2.20 time: 0.270054 May 26 14:00:35.381427 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 263/569] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:35 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1745 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:35.386785 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-196447e1-d8fb-4ddf-b782-3daf4d782fe0 req-054ee17a-76ab-406e-a2f6-d862b40bf52a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dddc973-36be-43e2-8971-e5e218dee91b", "tag": "c3710695-2c7b-4d4d-96bc-de38e27dc865"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:00:35.412227 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-196447e1-d8fb-4ddf-b782-3daf4d782fe0 req-054ee17a-76ab-406e-a2f6-d862b40bf52a service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:35.413016 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-196447e1-d8fb-4ddf-b782-3daf4d782fe0 req-054ee17a-76ab-406e-a2f6-d862b40bf52a service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:35.425449 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-196447e1-d8fb-4ddf-b782-3daf4d782fe0 req-054ee17a-76ab-406e-a2f6-d862b40bf52a service nova] Creating event network-changed:c3710695-2c7b-4d4d-96bc-de38e27dc865 for instance 5dddc973-36be-43e2-8971-e5e218dee91b on hv-cinder-84213 May 26 14:00:35.433391 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-196447e1-d8fb-4ddf-b782-3daf4d782fe0 req-054ee17a-76ab-406e-a2f6-d862b40bf52a service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050545 May 26 14:00:35.434120 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 264/570] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:00:35.439949 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7563cfa8-e561-4809-9ed6-0d03a8c33b97 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:35.440956 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7563cfa8-e561-4809-9ed6-0d03a8c33b97 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:35.448042 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7563cfa8-e561-4809-9ed6-0d03a8c33b97 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:35.448714 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7563cfa8-e561-4809-9ed6-0d03a8c33b97 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:35.459332 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7563cfa8-e561-4809-9ed6-0d03a8c33b97 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:35.459332 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7563cfa8-e561-4809-9ed6-0d03a8c33b97 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:35.534886 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-8db94f2a-44f7-4bd4-be96-f93fb13239c6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 14:00:35.535933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-8db94f2a-44f7-4bd4-be96-f93fb13239c6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 14:00:35.536572 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-8db94f2a-44f7-4bd4-be96-f93fb13239c6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 14:00:35.536950 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-8db94f2a-44f7-4bd4-be96-f93fb13239c6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 14:00:35.537383 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-8db94f2a-44f7-4bd4-be96-f93fb13239c6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 14:00:35.552537 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8db94f2a-44f7-4bd4-be96-f93fb13239c6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:35.553629 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8db94f2a-44f7-4bd4-be96-f93fb13239c6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:35.555660 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8db94f2a-44f7-4bd4-be96-f93fb13239c6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:35.555962 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8db94f2a-44f7-4bd4-be96-f93fb13239c6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:35.577559 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-8db94f2a-44f7-4bd4-be96-f93fb13239c6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Getting quotas for project ed15631acafd41528b96f2ed12c19e5b. Resources: {'ram', 'cores', 'instances'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 14:00:35.583363 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-8db94f2a-44f7-4bd4-be96-f93fb13239c6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Getting quotas for user 5068f06b1a8e47b88ba3294169545aa3 and project ed15631acafd41528b96f2ed12c19e5b. Resources: {'ram', 'cores', 'instances'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 14:00:35.625899 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7563cfa8-e561-4809-9ed6-0d03a8c33b97 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:35.656425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7563cfa8-e561-4809-9ed6-0d03a8c33b97 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.220876 May 26 14:00:35.659317 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8db94f2a-44f7-4bd4-be96-f93fb13239c6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 14:00:35.663116 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 265/571] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:35 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:35.663567 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8db94f2a-44f7-4bd4-be96-f93fb13239c6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='01c79ff6-ce9e-4a3f-bbf7-9a1fc154dbf3',volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 14:00:35.807463 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-26366845-61e0-4ec9-a4e0-408aa136cee2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:35.809351 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-26366845-61e0-4ec9-a4e0-408aa136cee2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:35.820307 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-26366845-61e0-4ec9-a4e0-408aa136cee2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:35.823600 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-26366845-61e0-4ec9-a4e0-408aa136cee2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:35.824827 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-26366845-61e0-4ec9-a4e0-408aa136cee2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:35.827481 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-26366845-61e0-4ec9-a4e0-408aa136cee2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:35.838342 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8db94f2a-44f7-4bd4-be96-f93fb13239c6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.341369 May 26 14:00:35.839566 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 307/572] 10.222.0.91 () {60 vars in 1146 bytes} [Thu May 26 14:00:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1343 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 14:00:35.850926 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c0c2e343-2c82-4f39-b83b-ee4ad0fb9df3 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:35.851812 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c0c2e343-2c82-4f39-b83b-ee4ad0fb9df3 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:35.939632 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c0c2e343-2c82-4f39-b83b-ee4ad0fb9df3 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:35.950713 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c0c2e343-2c82-4f39-b83b-ee4ad0fb9df3 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1093 microversion: 2.1 time: 0.103941 May 26 14:00:35.951414 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 308/573] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:35 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1093 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:36.061845 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-26366845-61e0-4ec9-a4e0-408aa136cee2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:36.073751 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-26366845-61e0-4ec9-a4e0-408aa136cee2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1259 microversion: 2.1 time: 0.271165 May 26 14:00:36.083634 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 266/574] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:35 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1259 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:36.089991 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-217e32ac-ffb0-4cb6-8c41-79e4d40dbf8e req-0846adc1-5af5-44bd-8e32-a98462254a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9116ee60-50e6-48c5-bcc1-8e9d08e35458", "name": "network-vif-plugged", "status": "completed", "tag": "0d486a1e-7691-438f-a89c-df9425b682f1"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:00:36.100630 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-217e32ac-ffb0-4cb6-8c41-79e4d40dbf8e req-0846adc1-5af5-44bd-8e32-a98462254a0d service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:36.101382 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-217e32ac-ffb0-4cb6-8c41-79e4d40dbf8e req-0846adc1-5af5-44bd-8e32-a98462254a0d service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:36.115890 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-217e32ac-ffb0-4cb6-8c41-79e4d40dbf8e req-0846adc1-5af5-44bd-8e32-a98462254a0d service nova] Creating event network-vif-plugged:0d486a1e-7691-438f-a89c-df9425b682f1 for instance 9116ee60-50e6-48c5-bcc1-8e9d08e35458 on hv-cinder-84213 May 26 14:00:36.123618 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-217e32ac-ffb0-4cb6-8c41-79e4d40dbf8e req-0846adc1-5af5-44bd-8e32-a98462254a0d service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038286 May 26 14:00:36.125370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 309/575] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:00:36.128611 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-46f5ecc2-0a06-41f6-8047-3602591f9a2d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:36.129279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-46f5ecc2-0a06-41f6-8047-3602591f9a2d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:36.142733 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-46f5ecc2-0a06-41f6-8047-3602591f9a2d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:36.143346 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-46f5ecc2-0a06-41f6-8047-3602591f9a2d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:36.144348 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-46f5ecc2-0a06-41f6-8047-3602591f9a2d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:36.144852 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-46f5ecc2-0a06-41f6-8047-3602591f9a2d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:36.316569 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-46f5ecc2-0a06-41f6-8047-3602591f9a2d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:36.331009 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-46f5ecc2-0a06-41f6-8047-3602591f9a2d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1366 microversion: 2.1 time: 0.206928 May 26 14:00:36.341248 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 267/576] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:36 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:00:36.401297 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-affd0e92-48a9-44eb-aafc-961f5ac28e2e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:36.404259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-affd0e92-48a9-44eb-aafc-961f5ac28e2e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:36.411328 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-affd0e92-48a9-44eb-aafc-961f5ac28e2e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:36.411770 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-affd0e92-48a9-44eb-aafc-961f5ac28e2e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:36.412702 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-affd0e92-48a9-44eb-aafc-961f5ac28e2e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:36.413132 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-affd0e92-48a9-44eb-aafc-961f5ac28e2e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:36.556416 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-affd0e92-48a9-44eb-aafc-961f5ac28e2e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:36.565437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-affd0e92-48a9-44eb-aafc-961f5ac28e2e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:36.567379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-affd0e92-48a9-44eb-aafc-961f5ac28e2e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:36.568795 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-affd0e92-48a9-44eb-aafc-961f5ac28e2e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1745 microversion: 2.20 time: 0.172457 May 26 14:00:36.569738 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 310/577] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:36 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:36.674473 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-70846122-337d-4a11-a641-eec04a5a3f71 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:36.674997 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-70846122-337d-4a11-a641-eec04a5a3f71 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:36.682255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-70846122-337d-4a11-a641-eec04a5a3f71 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:36.682941 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-70846122-337d-4a11-a641-eec04a5a3f71 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:36.683705 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-70846122-337d-4a11-a641-eec04a5a3f71 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:36.684140 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-70846122-337d-4a11-a641-eec04a5a3f71 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:36.833006 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-70846122-337d-4a11-a641-eec04a5a3f71 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:36.841674 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-70846122-337d-4a11-a641-eec04a5a3f71 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.171081 May 26 14:00:36.842254 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 268/578] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:36 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:00:36.968721 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-169bb6c4-b87e-42bf-a443-f53e866af823 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:36.969406 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-169bb6c4-b87e-42bf-a443-f53e866af823 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:36.977068 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-169bb6c4-b87e-42bf-a443-f53e866af823 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:36.978130 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-169bb6c4-b87e-42bf-a443-f53e866af823 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:36.978941 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-169bb6c4-b87e-42bf-a443-f53e866af823 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:36.979400 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-169bb6c4-b87e-42bf-a443-f53e866af823 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:36.982911 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:37.058237 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-169bb6c4-b87e-42bf-a443-f53e866af823 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:37.069801 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-169bb6c4-b87e-42bf-a443-f53e866af823 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1143 microversion: 2.1 time: 0.103628 May 26 14:00:37.079558 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 311/579] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:36 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1143 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:37.091040 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a3b3b5e2-be09-4975-85fa-101210002dc5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:37.091853 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a3b3b5e2-be09-4975-85fa-101210002dc5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:37.098553 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a3b3b5e2-be09-4975-85fa-101210002dc5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:37.099368 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a3b3b5e2-be09-4975-85fa-101210002dc5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:37.100250 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a3b3b5e2-be09-4975-85fa-101210002dc5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:37.100804 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a3b3b5e2-be09-4975-85fa-101210002dc5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:37.273830 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a3b3b5e2-be09-4975-85fa-101210002dc5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:37.281818 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a3b3b5e2-be09-4975-85fa-101210002dc5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1259 microversion: 2.1 time: 0.195287 May 26 14:00:37.282616 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 269/580] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:37 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:37.348274 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7094724d-3a80-4559-a957-b30e3523fa05 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:37.348887 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7094724d-3a80-4559-a957-b30e3523fa05 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:37.355639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7094724d-3a80-4559-a957-b30e3523fa05 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:37.356099 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7094724d-3a80-4559-a957-b30e3523fa05 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:37.357011 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7094724d-3a80-4559-a957-b30e3523fa05 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:37.357669 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7094724d-3a80-4559-a957-b30e3523fa05 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:37.503713 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7094724d-3a80-4559-a957-b30e3523fa05 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:37.513060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7094724d-3a80-4559-a957-b30e3523fa05 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1366 microversion: 2.1 time: 0.168771 May 26 14:00:37.516107 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 312/581] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:37 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:37.587774 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-01ffc49d-8263-4bf1-8b4d-3f81840c636f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:37.588379 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-01ffc49d-8263-4bf1-8b4d-3f81840c636f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:37.596295 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-01ffc49d-8263-4bf1-8b4d-3f81840c636f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:37.596999 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-01ffc49d-8263-4bf1-8b4d-3f81840c636f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:37.597822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-01ffc49d-8263-4bf1-8b4d-3f81840c636f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:37.598460 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-01ffc49d-8263-4bf1-8b4d-3f81840c636f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:37.751564 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-01ffc49d-8263-4bf1-8b4d-3f81840c636f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:37.761652 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-01ffc49d-8263-4bf1-8b4d-3f81840c636f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:37.763136 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-01ffc49d-8263-4bf1-8b4d-3f81840c636f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:37.764470 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-01ffc49d-8263-4bf1-8b4d-3f81840c636f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1745 microversion: 2.20 time: 0.181171 May 26 14:00:37.769330 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 270/582] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:37 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1745 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:00:37.859154 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-54fa1ba3-2be1-4728-84b6-c5a86c43525f tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:37.859840 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-54fa1ba3-2be1-4728-84b6-c5a86c43525f tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:37.866573 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-54fa1ba3-2be1-4728-84b6-c5a86c43525f tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:37.867100 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-54fa1ba3-2be1-4728-84b6-c5a86c43525f tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:37.868599 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-54fa1ba3-2be1-4728-84b6-c5a86c43525f tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:37.869124 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-54fa1ba3-2be1-4728-84b6-c5a86c43525f tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:38.018681 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-54fa1ba3-2be1-4728-84b6-c5a86c43525f tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:38.028394 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-54fa1ba3-2be1-4728-84b6-c5a86c43525f tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.173318 May 26 14:00:38.028972 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 313/583] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:37 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:38.088252 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8e5b83a5-422b-4060-bbf9-e72aa9991c20 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:38.089113 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8e5b83a5-422b-4060-bbf9-e72aa9991c20 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:38.095542 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8e5b83a5-422b-4060-bbf9-e72aa9991c20 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:38.096007 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8e5b83a5-422b-4060-bbf9-e72aa9991c20 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:38.096796 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8e5b83a5-422b-4060-bbf9-e72aa9991c20 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:38.097256 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8e5b83a5-422b-4060-bbf9-e72aa9991c20 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:38.160101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8e5b83a5-422b-4060-bbf9-e72aa9991c20 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:38.170889 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8e5b83a5-422b-4060-bbf9-e72aa9991c20 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1143 microversion: 2.1 time: 0.088788 May 26 14:00:38.172032 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 271/584] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:38 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1143 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:38.298905 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a2a3fdb9-3a73-4e74-b691-d28f104f409c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:38.299441 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a2a3fdb9-3a73-4e74-b691-d28f104f409c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:38.306491 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2a3fdb9-3a73-4e74-b691-d28f104f409c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:38.306953 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2a3fdb9-3a73-4e74-b691-d28f104f409c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:38.307735 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2a3fdb9-3a73-4e74-b691-d28f104f409c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:38.308173 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2a3fdb9-3a73-4e74-b691-d28f104f409c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:38.519155 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a2a3fdb9-3a73-4e74-b691-d28f104f409c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:38.531766 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-738bf951-00e4-4ba7-b76a-2531dc1230e2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:38.532936 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-738bf951-00e4-4ba7-b76a-2531dc1230e2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:38.541966 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a2a3fdb9-3a73-4e74-b691-d28f104f409c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1259 microversion: 2.1 time: 0.247000 May 26 14:00:38.544211 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 314/585] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:38 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1259 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:38.544546 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-738bf951-00e4-4ba7-b76a-2531dc1230e2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:38.545034 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-738bf951-00e4-4ba7-b76a-2531dc1230e2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:38.545945 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-738bf951-00e4-4ba7-b76a-2531dc1230e2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:38.548173 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-738bf951-00e4-4ba7-b76a-2531dc1230e2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:38.782917 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-92ffb764-9e00-4365-aced-8422be347cf5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:38.783990 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-92ffb764-9e00-4365-aced-8422be347cf5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:38.793540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-92ffb764-9e00-4365-aced-8422be347cf5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:38.794235 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-92ffb764-9e00-4365-aced-8422be347cf5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:38.794941 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-92ffb764-9e00-4365-aced-8422be347cf5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:38.795394 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-92ffb764-9e00-4365-aced-8422be347cf5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:38.797996 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-738bf951-00e4-4ba7-b76a-2531dc1230e2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:38.810462 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-738bf951-00e4-4ba7-b76a-2531dc1230e2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1366 microversion: 2.1 time: 0.284465 May 26 14:00:38.811673 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 272/586] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:38 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:00:38.942735 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-92ffb764-9e00-4365-aced-8422be347cf5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:38.951430 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-92ffb764-9e00-4365-aced-8422be347cf5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:38.953101 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-92ffb764-9e00-4365-aced-8422be347cf5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:38.954368 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-92ffb764-9e00-4365-aced-8422be347cf5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1745 microversion: 2.20 time: 0.175307 May 26 14:00:38.955000 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 315/587] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:38 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:00:39.047247 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-36067596-6cf0-43c9-aa16-51e1b09d21d8 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:39.048362 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-36067596-6cf0-43c9-aa16-51e1b09d21d8 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:39.057296 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36067596-6cf0-43c9-aa16-51e1b09d21d8 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:39.057942 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36067596-6cf0-43c9-aa16-51e1b09d21d8 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:39.058899 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36067596-6cf0-43c9-aa16-51e1b09d21d8 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:39.059344 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36067596-6cf0-43c9-aa16-51e1b09d21d8 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:39.187910 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c04503ed-27c5-4623-8782-e544cf7e9bca tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:39.189597 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c04503ed-27c5-4623-8782-e544cf7e9bca tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:39.198157 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c04503ed-27c5-4623-8782-e544cf7e9bca tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:39.198824 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c04503ed-27c5-4623-8782-e544cf7e9bca tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:39.200391 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c04503ed-27c5-4623-8782-e544cf7e9bca tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:39.200836 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c04503ed-27c5-4623-8782-e544cf7e9bca tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:39.226075 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-36067596-6cf0-43c9-aa16-51e1b09d21d8 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:39.234898 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-36067596-6cf0-43c9-aa16-51e1b09d21d8 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.192642 May 26 14:00:39.239694 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 273/588] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:39 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:39.266254 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c04503ed-27c5-4623-8782-e544cf7e9bca tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:39.274793 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c04503ed-27c5-4623-8782-e544cf7e9bca tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1191 microversion: 2.1 time: 0.090371 May 26 14:00:39.284904 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 316/589] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:39 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1191 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:00:39.559560 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ea1992e3-7535-4555-9577-80bac4e0cc4a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:39.560199 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ea1992e3-7535-4555-9577-80bac4e0cc4a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:39.566401 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ea1992e3-7535-4555-9577-80bac4e0cc4a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:39.566890 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ea1992e3-7535-4555-9577-80bac4e0cc4a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:39.567702 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ea1992e3-7535-4555-9577-80bac4e0cc4a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:39.568142 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ea1992e3-7535-4555-9577-80bac4e0cc4a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:39.693279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ea1992e3-7535-4555-9577-80bac4e0cc4a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:39.701072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ea1992e3-7535-4555-9577-80bac4e0cc4a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1259 microversion: 2.1 time: 0.145318 May 26 14:00:39.701661 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 274/590] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:39 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1259 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:39.827840 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-474fcfcb-3f0b-4aa1-9011-fef22ee53c75 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:39.828445 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-474fcfcb-3f0b-4aa1-9011-fef22ee53c75 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:39.834729 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-474fcfcb-3f0b-4aa1-9011-fef22ee53c75 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:39.835166 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-474fcfcb-3f0b-4aa1-9011-fef22ee53c75 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:39.835973 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-474fcfcb-3f0b-4aa1-9011-fef22ee53c75 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:39.836356 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-474fcfcb-3f0b-4aa1-9011-fef22ee53c75 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:39.972938 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b1d9e33f-c7ad-40f4-b1c2-e1486bfd8fac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:39.973706 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b1d9e33f-c7ad-40f4-b1c2-e1486bfd8fac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:39.979949 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b1d9e33f-c7ad-40f4-b1c2-e1486bfd8fac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:39.980407 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b1d9e33f-c7ad-40f4-b1c2-e1486bfd8fac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:39.981289 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b1d9e33f-c7ad-40f4-b1c2-e1486bfd8fac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:39.981739 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b1d9e33f-c7ad-40f4-b1c2-e1486bfd8fac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:39.981844 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-474fcfcb-3f0b-4aa1-9011-fef22ee53c75 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:39.992224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-474fcfcb-3f0b-4aa1-9011-fef22ee53c75 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1366 microversion: 2.1 time: 0.168141 May 26 14:00:40.002282 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 317/591] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:39 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:40.112459 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b1d9e33f-c7ad-40f4-b1c2-e1486bfd8fac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:40.120910 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b1d9e33f-c7ad-40f4-b1c2-e1486bfd8fac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:40.122438 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b1d9e33f-c7ad-40f4-b1c2-e1486bfd8fac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:40.123579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b1d9e33f-c7ad-40f4-b1c2-e1486bfd8fac tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1745 microversion: 2.20 time: 0.154594 May 26 14:00:40.124136 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 275/592] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:39 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:00:40.251686 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d41babc2-59d4-47da-b3a5-0b5e3adea1b3 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:40.252269 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d41babc2-59d4-47da-b3a5-0b5e3adea1b3 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:40.254569 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:40.260365 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d41babc2-59d4-47da-b3a5-0b5e3adea1b3 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:40.260816 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d41babc2-59d4-47da-b3a5-0b5e3adea1b3 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:40.261617 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d41babc2-59d4-47da-b3a5-0b5e3adea1b3 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:40.262056 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d41babc2-59d4-47da-b3a5-0b5e3adea1b3 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:40.293048 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fa064f1d-0d4e-4b68-b851-2bda606a0b0e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:40.293685 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-fa064f1d-0d4e-4b68-b851-2bda606a0b0e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:40.300185 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fa064f1d-0d4e-4b68-b851-2bda606a0b0e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:40.300648 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fa064f1d-0d4e-4b68-b851-2bda606a0b0e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:40.301453 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fa064f1d-0d4e-4b68-b851-2bda606a0b0e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:40.301897 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fa064f1d-0d4e-4b68-b851-2bda606a0b0e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:40.306902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:40.379591 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-fa064f1d-0d4e-4b68-b851-2bda606a0b0e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:40.387119 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-fa064f1d-0d4e-4b68-b851-2bda606a0b0e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1191 microversion: 2.1 time: 0.098469 May 26 14:00:40.387695 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 276/593] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:40 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1191 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:00:40.413869 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d41babc2-59d4-47da-b3a5-0b5e3adea1b3 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:40.422138 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d41babc2-59d4-47da-b3a5-0b5e3adea1b3 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.174424 May 26 14:00:40.422719 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 318/594] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:40 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:40.717713 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bf115f28-fc61-42be-9659-7ed9228956a2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:40.718321 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bf115f28-fc61-42be-9659-7ed9228956a2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:40.724718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bf115f28-fc61-42be-9659-7ed9228956a2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:40.725192 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bf115f28-fc61-42be-9659-7ed9228956a2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:40.725957 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bf115f28-fc61-42be-9659-7ed9228956a2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:40.726395 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bf115f28-fc61-42be-9659-7ed9228956a2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:40.862502 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bf115f28-fc61-42be-9659-7ed9228956a2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:40.870270 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bf115f28-fc61-42be-9659-7ed9228956a2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1259 microversion: 2.1 time: 0.156478 May 26 14:00:40.870844 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 277/595] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:40 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:41.010120 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-27e06087-db71-4fd0-bf7c-acd5cacfc608 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:41.010712 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-27e06087-db71-4fd0-bf7c-acd5cacfc608 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:41.016773 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27e06087-db71-4fd0-bf7c-acd5cacfc608 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:41.017258 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27e06087-db71-4fd0-bf7c-acd5cacfc608 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:41.018028 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27e06087-db71-4fd0-bf7c-acd5cacfc608 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:41.018894 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27e06087-db71-4fd0-bf7c-acd5cacfc608 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:41.142673 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-abfac968-0f69-4c36-9915-954058cd7531 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:41.143674 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-abfac968-0f69-4c36-9915-954058cd7531 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:41.151633 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-abfac968-0f69-4c36-9915-954058cd7531 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:41.152125 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-abfac968-0f69-4c36-9915-954058cd7531 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:41.153111 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-abfac968-0f69-4c36-9915-954058cd7531 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:41.153950 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-abfac968-0f69-4c36-9915-954058cd7531 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:41.167032 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-27e06087-db71-4fd0-bf7c-acd5cacfc608 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:41.180985 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-27e06087-db71-4fd0-bf7c-acd5cacfc608 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1366 microversion: 2.1 time: 0.174942 May 26 14:00:41.181547 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 319/596] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:41 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:41.317662 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-abfac968-0f69-4c36-9915-954058cd7531 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:41.327255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-abfac968-0f69-4c36-9915-954058cd7531 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:41.328773 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-abfac968-0f69-4c36-9915-954058cd7531 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:41.330151 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-abfac968-0f69-4c36-9915-954058cd7531 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1745 microversion: 2.20 time: 0.191297 May 26 14:00:41.330548 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 278/597] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:41 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1745 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:00:41.404127 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d5a52d17-0dc2-4692-b210-297f1046adb9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:41.404735 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d5a52d17-0dc2-4692-b210-297f1046adb9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:41.411673 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d5a52d17-0dc2-4692-b210-297f1046adb9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:41.412124 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d5a52d17-0dc2-4692-b210-297f1046adb9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:41.412893 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d5a52d17-0dc2-4692-b210-297f1046adb9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:41.413357 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d5a52d17-0dc2-4692-b210-297f1046adb9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:41.441231 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-be3f4f46-a467-4f19-894b-38d00e77174d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:41.442125 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-be3f4f46-a467-4f19-894b-38d00e77174d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:41.449084 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-be3f4f46-a467-4f19-894b-38d00e77174d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:41.452298 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-be3f4f46-a467-4f19-894b-38d00e77174d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:41.453080 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-be3f4f46-a467-4f19-894b-38d00e77174d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:41.453545 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-be3f4f46-a467-4f19-894b-38d00e77174d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:41.503899 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d5a52d17-0dc2-4692-b210-297f1046adb9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:41.517530 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d5a52d17-0dc2-4692-b210-297f1046adb9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1191 microversion: 2.1 time: 0.114455 May 26 14:00:41.518153 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 320/598] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:41 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1191 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:41.626743 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-be3f4f46-a467-4f19-894b-38d00e77174d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:41.635062 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-be3f4f46-a467-4f19-894b-38d00e77174d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.199587 May 26 14:00:41.635646 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 279/599] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:41 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:00:41.886861 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6a413b48-068f-43f7-b430-e627c07f10e5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:41.887656 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6a413b48-068f-43f7-b430-e627c07f10e5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:41.897625 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6a413b48-068f-43f7-b430-e627c07f10e5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:41.898102 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6a413b48-068f-43f7-b430-e627c07f10e5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:41.898881 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6a413b48-068f-43f7-b430-e627c07f10e5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:41.899317 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6a413b48-068f-43f7-b430-e627c07f10e5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:42.035271 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6a413b48-068f-43f7-b430-e627c07f10e5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:42.047069 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6a413b48-068f-43f7-b430-e627c07f10e5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1259 microversion: 2.1 time: 0.163978 May 26 14:00:42.047652 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 321/600] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:41 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:42.166272 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-3f97eb98-8f2b-4a8e-9419-45798e204c76 req-18062530-36ed-44a9-8ba5-0b06a175a8ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dddc973-36be-43e2-8971-e5e218dee91b", "name": "network-vif-plugged", "status": "completed", "tag": "c3710695-2c7b-4d4d-96bc-de38e27dc865"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:00:42.174614 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-3f97eb98-8f2b-4a8e-9419-45798e204c76 req-18062530-36ed-44a9-8ba5-0b06a175a8ee service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:42.180418 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-3f97eb98-8f2b-4a8e-9419-45798e204c76 req-18062530-36ed-44a9-8ba5-0b06a175a8ee service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:42.198033 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-3f97eb98-8f2b-4a8e-9419-45798e204c76 req-18062530-36ed-44a9-8ba5-0b06a175a8ee service nova] Creating event network-vif-plugged:c3710695-2c7b-4d4d-96bc-de38e27dc865 for instance 5dddc973-36be-43e2-8971-e5e218dee91b on hv-cinder-84213 May 26 14:00:42.198950 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f69308c9-6a49-4bc3-a86d-81ff5a78b1f3 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:42.199789 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f69308c9-6a49-4bc3-a86d-81ff5a78b1f3 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:42.203095 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-3f97eb98-8f2b-4a8e-9419-45798e204c76 req-18062530-36ed-44a9-8ba5-0b06a175a8ee service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041156 May 26 14:00:42.203877 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 280/601] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:00:42.205952 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f69308c9-6a49-4bc3-a86d-81ff5a78b1f3 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:42.206479 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f69308c9-6a49-4bc3-a86d-81ff5a78b1f3 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:42.207354 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f69308c9-6a49-4bc3-a86d-81ff5a78b1f3 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:42.207688 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f69308c9-6a49-4bc3-a86d-81ff5a78b1f3 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:42.338312 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f69308c9-6a49-4bc3-a86d-81ff5a78b1f3 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:42.345755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f69308c9-6a49-4bc3-a86d-81ff5a78b1f3 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1366 microversion: 2.1 time: 0.151977 May 26 14:00:42.346317 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 322/602] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:42 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:00:42.353561 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-44dfb799-5fab-4b8f-bae8-2e5255787b99 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:42.353561 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-44dfb799-5fab-4b8f-bae8-2e5255787b99 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:42.355968 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-44dfb799-5fab-4b8f-bae8-2e5255787b99 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:42.356415 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-44dfb799-5fab-4b8f-bae8-2e5255787b99 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:42.357190 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-44dfb799-5fab-4b8f-bae8-2e5255787b99 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:42.357624 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-44dfb799-5fab-4b8f-bae8-2e5255787b99 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:42.538889 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-02929980-6b1b-4e0a-b421-5b86a94e90d2 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:42.541592 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-02929980-6b1b-4e0a-b421-5b86a94e90d2 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:42.566718 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-02929980-6b1b-4e0a-b421-5b86a94e90d2 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:42.567172 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-02929980-6b1b-4e0a-b421-5b86a94e90d2 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:42.567961 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-02929980-6b1b-4e0a-b421-5b86a94e90d2 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:42.568399 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-02929980-6b1b-4e0a-b421-5b86a94e90d2 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:42.588318 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-44dfb799-5fab-4b8f-bae8-2e5255787b99 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:42.605593 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-44dfb799-5fab-4b8f-bae8-2e5255787b99 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:42.612627 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-44dfb799-5fab-4b8f-bae8-2e5255787b99 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:42.618483 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-44dfb799-5fab-4b8f-bae8-2e5255787b99 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1745 microversion: 2.20 time: 0.274094 May 26 14:00:42.619155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 281/603] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:42 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1745 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:00:42.653691 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-efe984f2-ee76-406e-918d-e1189bf51646 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:42.654937 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-efe984f2-ee76-406e-918d-e1189bf51646 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:42.659704 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-02929980-6b1b-4e0a-b421-5b86a94e90d2 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:42.661603 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-efe984f2-ee76-406e-918d-e1189bf51646 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:42.662242 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-efe984f2-ee76-406e-918d-e1189bf51646 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:42.663353 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-efe984f2-ee76-406e-918d-e1189bf51646 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:42.664195 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-efe984f2-ee76-406e-918d-e1189bf51646 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:42.669079 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-02929980-6b1b-4e0a-b421-5b86a94e90d2 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1191 microversion: 2.1 time: 0.137567 May 26 14:00:42.670182 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 323/604] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:42 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1191 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:00:42.793581 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-efe984f2-ee76-406e-918d-e1189bf51646 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:42.801078 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-efe984f2-ee76-406e-918d-e1189bf51646 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.152633 May 26 14:00:42.801993 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 282/605] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:42 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:43.063786 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cc7cdad2-8c64-49d3-a774-3f109a2dc0ae tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:43.071011 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-cc7cdad2-8c64-49d3-a774-3f109a2dc0ae tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:43.081088 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cc7cdad2-8c64-49d3-a774-3f109a2dc0ae tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:43.084160 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cc7cdad2-8c64-49d3-a774-3f109a2dc0ae tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:43.085178 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cc7cdad2-8c64-49d3-a774-3f109a2dc0ae tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:43.085779 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cc7cdad2-8c64-49d3-a774-3f109a2dc0ae tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:43.363514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-70833c4b-3a01-49e4-a13b-4030baa1ef98 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:43.364139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-70833c4b-3a01-49e4-a13b-4030baa1ef98 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:43.372789 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-70833c4b-3a01-49e4-a13b-4030baa1ef98 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:43.380722 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-70833c4b-3a01-49e4-a13b-4030baa1ef98 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:43.381661 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-70833c4b-3a01-49e4-a13b-4030baa1ef98 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:43.382314 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-70833c4b-3a01-49e4-a13b-4030baa1ef98 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:43.543423 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cc7cdad2-8c64-49d3-a774-3f109a2dc0ae tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:43.556883 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-cc7cdad2-8c64-49d3-a774-3f109a2dc0ae tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1259 microversion: 2.1 time: 0.496511 May 26 14:00:43.557892 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 324/606] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:43 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1259 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:43.624340 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-70833c4b-3a01-49e4-a13b-4030baa1ef98 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:43.632112 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-70833c4b-3a01-49e4-a13b-4030baa1ef98 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1366 microversion: 2.1 time: 0.272806 May 26 14:00:43.632784 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 283/607] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:43 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:43.636761 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fa29f292-5b6a-4d05-a47c-6cc82a30ece9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:43.637397 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fa29f292-5b6a-4d05-a47c-6cc82a30ece9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:43.644353 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fa29f292-5b6a-4d05-a47c-6cc82a30ece9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:43.644855 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fa29f292-5b6a-4d05-a47c-6cc82a30ece9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:43.645684 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fa29f292-5b6a-4d05-a47c-6cc82a30ece9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:43.646297 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fa29f292-5b6a-4d05-a47c-6cc82a30ece9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:43.686111 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6c17da58-718d-4454-bc4b-725fb0a72ec4 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:43.686787 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6c17da58-718d-4454-bc4b-725fb0a72ec4 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:43.693103 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6c17da58-718d-4454-bc4b-725fb0a72ec4 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:43.693580 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6c17da58-718d-4454-bc4b-725fb0a72ec4 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:43.694579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6c17da58-718d-4454-bc4b-725fb0a72ec4 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:43.694979 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6c17da58-718d-4454-bc4b-725fb0a72ec4 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:43.776347 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6c17da58-718d-4454-bc4b-725fb0a72ec4 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:43.786083 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6c17da58-718d-4454-bc4b-725fb0a72ec4 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1209 microversion: 2.1 time: 0.103647 May 26 14:00:43.786782 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 284/608] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:43 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1209 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:43.819360 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fa29f292-5b6a-4d05-a47c-6cc82a30ece9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:43.824678 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b3688b19-c612-4bab-acf9-3761bd81fffc tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:43.825740 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b3688b19-c612-4bab-acf9-3761bd81fffc tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:43.828639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fa29f292-5b6a-4d05-a47c-6cc82a30ece9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:43.831543 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fa29f292-5b6a-4d05-a47c-6cc82a30ece9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:43.833453 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fa29f292-5b6a-4d05-a47c-6cc82a30ece9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1745 microversion: 2.20 time: 0.201472 May 26 14:00:43.833674 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b3688b19-c612-4bab-acf9-3761bd81fffc tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:43.834239 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b3688b19-c612-4bab-acf9-3761bd81fffc tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:43.834981 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b3688b19-c612-4bab-acf9-3761bd81fffc tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:43.835454 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b3688b19-c612-4bab-acf9-3761bd81fffc tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:43.846934 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 325/609] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:43 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1745 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:43.980913 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b3688b19-c612-4bab-acf9-3761bd81fffc tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:43.988587 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b3688b19-c612-4bab-acf9-3761bd81fffc tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.174125 May 26 14:00:43.989370 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 285/610] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:43 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:00:44.574816 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a02b7d16-232f-48e4-b5d6-feacb121e779 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:44.576416 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a02b7d16-232f-48e4-b5d6-feacb121e779 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:44.583750 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a02b7d16-232f-48e4-b5d6-feacb121e779 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:44.584333 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a02b7d16-232f-48e4-b5d6-feacb121e779 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:44.585422 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a02b7d16-232f-48e4-b5d6-feacb121e779 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:44.585969 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a02b7d16-232f-48e4-b5d6-feacb121e779 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:44.654211 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e622cfd3-e9da-417d-8c89-180d76610562 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:44.655493 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e622cfd3-e9da-417d-8c89-180d76610562 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:44.670371 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e622cfd3-e9da-417d-8c89-180d76610562 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:44.671785 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e622cfd3-e9da-417d-8c89-180d76610562 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:44.674696 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e622cfd3-e9da-417d-8c89-180d76610562 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:44.675787 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e622cfd3-e9da-417d-8c89-180d76610562 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:44.879813 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a02b7d16-232f-48e4-b5d6-feacb121e779 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:44.888270 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a02b7d16-232f-48e4-b5d6-feacb121e779 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1259 microversion: 2.1 time: 0.318169 May 26 14:00:44.898029 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 326/611] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:44 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1259 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:44.904009 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5566383c-2ace-494b-9cde-11ba4ef7f23d tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:44.904654 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5566383c-2ace-494b-9cde-11ba4ef7f23d tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:44.911160 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5566383c-2ace-494b-9cde-11ba4ef7f23d tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:44.911846 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5566383c-2ace-494b-9cde-11ba4ef7f23d tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:44.912947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5566383c-2ace-494b-9cde-11ba4ef7f23d tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:44.913423 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5566383c-2ace-494b-9cde-11ba4ef7f23d tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:45.002381 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5566383c-2ace-494b-9cde-11ba4ef7f23d tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:45.004993 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:45.011461 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5566383c-2ace-494b-9cde-11ba4ef7f23d tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1209 microversion: 2.1 time: 0.112064 May 26 14:00:45.012259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 327/612] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:44 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1209 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:45.017269 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e622cfd3-e9da-417d-8c89-180d76610562 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:45.024988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e622cfd3-e9da-417d-8c89-180d76610562 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1366 microversion: 2.1 time: 0.379404 May 26 14:00:45.029192 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 286/613] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:44 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1366 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:45.030652 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-68104f80-db36-422b-8f12-b5fcef994c08 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:45.031572 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-68104f80-db36-422b-8f12-b5fcef994c08 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:45.032571 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-aca34ddd-720d-42c3-8096-92d1fe84a4e6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:45.033485 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-aca34ddd-720d-42c3-8096-92d1fe84a4e6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:45.037933 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68104f80-db36-422b-8f12-b5fcef994c08 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:45.038446 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68104f80-db36-422b-8f12-b5fcef994c08 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:45.039227 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68104f80-db36-422b-8f12-b5fcef994c08 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:45.040179 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68104f80-db36-422b-8f12-b5fcef994c08 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:45.042228 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aca34ddd-720d-42c3-8096-92d1fe84a4e6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:45.043053 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aca34ddd-720d-42c3-8096-92d1fe84a4e6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:45.045184 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aca34ddd-720d-42c3-8096-92d1fe84a4e6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:45.045501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aca34ddd-720d-42c3-8096-92d1fe84a4e6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:45.273684 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-aca34ddd-720d-42c3-8096-92d1fe84a4e6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:45.282592 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-68104f80-db36-422b-8f12-b5fcef994c08 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:45.283932 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-aca34ddd-720d-42c3-8096-92d1fe84a4e6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:45.285730 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-aca34ddd-720d-42c3-8096-92d1fe84a4e6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:45.287562 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-aca34ddd-720d-42c3-8096-92d1fe84a4e6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1740 microversion: 2.20 time: 0.274016 May 26 14:00:45.288319 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 328/614] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:45 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1740 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:45.292842 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-68104f80-db36-422b-8f12-b5fcef994c08 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.266252 May 26 14:00:45.293963 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 287/615] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:45 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:45.910004 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2bda48de-eeda-4192-9493-04e73ab4d488 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:45.910777 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2bda48de-eeda-4192-9493-04e73ab4d488 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:45.912827 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:45.920328 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2bda48de-eeda-4192-9493-04e73ab4d488 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:45.921067 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2bda48de-eeda-4192-9493-04e73ab4d488 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:45.922249 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2bda48de-eeda-4192-9493-04e73ab4d488 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:45.922380 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2bda48de-eeda-4192-9493-04e73ab4d488 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:45.949113 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=8 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:46.031919 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c37d4d17-001b-4a7a-9951-74b9e8f8f20e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:46.033664 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c37d4d17-001b-4a7a-9951-74b9e8f8f20e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:46.051212 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c37d4d17-001b-4a7a-9951-74b9e8f8f20e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:46.051685 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c37d4d17-001b-4a7a-9951-74b9e8f8f20e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:46.052434 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c37d4d17-001b-4a7a-9951-74b9e8f8f20e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:46.053230 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c37d4d17-001b-4a7a-9951-74b9e8f8f20e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:46.136154 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2bda48de-eeda-4192-9493-04e73ab4d488 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:46.146179 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2bda48de-eeda-4192-9493-04e73ab4d488 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1259 microversion: 2.1 time: 0.243701 May 26 14:00:46.159458 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 329/616] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:45 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1259 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:46.164296 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c37d4d17-001b-4a7a-9951-74b9e8f8f20e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:46.165224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8b848538-73f1-4189-a46a-6d5d93a93c3a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:46.165958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8b848538-73f1-4189-a46a-6d5d93a93c3a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:46.181225 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8b848538-73f1-4189-a46a-6d5d93a93c3a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:46.182546 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8b848538-73f1-4189-a46a-6d5d93a93c3a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:46.183768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8b848538-73f1-4189-a46a-6d5d93a93c3a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:46.183915 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c37d4d17-001b-4a7a-9951-74b9e8f8f20e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1209 microversion: 2.1 time: 0.158024 May 26 14:00:46.184428 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 288/617] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:46 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1209 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:00:46.185454 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8b848538-73f1-4189-a46a-6d5d93a93c3a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:46.310579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-48273a9b-fa12-48d2-aed9-fb5f356d61c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:46.312096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-48273a9b-fa12-48d2-aed9-fb5f356d61c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:46.329983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48273a9b-fa12-48d2-aed9-fb5f356d61c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:46.330469 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48273a9b-fa12-48d2-aed9-fb5f356d61c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:46.332899 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48273a9b-fa12-48d2-aed9-fb5f356d61c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:46.333646 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48273a9b-fa12-48d2-aed9-fb5f356d61c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:46.505754 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8b848538-73f1-4189-a46a-6d5d93a93c3a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:46.516697 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8b848538-73f1-4189-a46a-6d5d93a93c3a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1366 microversion: 2.1 time: 0.355947 May 26 14:00:46.531591 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 330/618] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:46 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1366 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:46.549257 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9f99109e-8025-434a-bbb4-fecac67459d7 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:46.549498 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9f99109e-8025-434a-bbb4-fecac67459d7 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:46.563775 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9f99109e-8025-434a-bbb4-fecac67459d7 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:46.564496 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9f99109e-8025-434a-bbb4-fecac67459d7 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:46.569534 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9f99109e-8025-434a-bbb4-fecac67459d7 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:46.575629 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9f99109e-8025-434a-bbb4-fecac67459d7 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:46.634316 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-48273a9b-fa12-48d2-aed9-fb5f356d61c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:46.651316 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-48273a9b-fa12-48d2-aed9-fb5f356d61c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:46.652871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-48273a9b-fa12-48d2-aed9-fb5f356d61c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:46.654091 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-48273a9b-fa12-48d2-aed9-fb5f356d61c3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1740 microversion: 2.20 time: 0.349888 May 26 14:00:46.666267 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 289/619] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:46 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1740 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:46.678078 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-d3fced06-8005-43ea-9843-f1493c87a7b0 req-94a1e802-80bd-41d9-ad66-beae81225a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c8745d-a394-4026-a5c4-b5ce4c5590e0", "name": "network-vif-plugged", "status": "completed", "tag": "3d450e70-f1c7-407d-adbd-6d7812d913c3"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:00:46.700188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-d3fced06-8005-43ea-9843-f1493c87a7b0 req-94a1e802-80bd-41d9-ad66-beae81225a17 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:46.700914 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-d3fced06-8005-43ea-9843-f1493c87a7b0 req-94a1e802-80bd-41d9-ad66-beae81225a17 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:46.722403 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-d3fced06-8005-43ea-9843-f1493c87a7b0 req-94a1e802-80bd-41d9-ad66-beae81225a17 service nova] Creating event network-vif-plugged:3d450e70-f1c7-407d-adbd-6d7812d913c3 for instance 40c8745d-a394-4026-a5c4-b5ce4c5590e0 on hv-cinder-84213 May 26 14:00:46.733754 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-d3fced06-8005-43ea-9843-f1493c87a7b0 req-94a1e802-80bd-41d9-ad66-beae81225a17 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066070 May 26 14:00:46.734830 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 290/620] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:00:46.858756 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9f99109e-8025-434a-bbb4-fecac67459d7 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:46.874848 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9f99109e-8025-434a-bbb4-fecac67459d7 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1359 microversion: 2.1 time: 0.323001 May 26 14:00:46.875805 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 331/621] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:46 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1359 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:47.166287 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-29cc3073-bc6c-44d8-a3b8-13205cab644f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:47.167641 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-29cc3073-bc6c-44d8-a3b8-13205cab644f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:47.169928 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:47.184118 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-29cc3073-bc6c-44d8-a3b8-13205cab644f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:47.184855 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-29cc3073-bc6c-44d8-a3b8-13205cab644f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:47.185984 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-29cc3073-bc6c-44d8-a3b8-13205cab644f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:47.186586 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-29cc3073-bc6c-44d8-a3b8-13205cab644f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:47.202892 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-be7516e7-5345-4bc1-8871-15b9616c1e7d tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:47.203482 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-be7516e7-5345-4bc1-8871-15b9616c1e7d tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:47.222089 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-be7516e7-5345-4bc1-8871-15b9616c1e7d tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:47.222539 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-be7516e7-5345-4bc1-8871-15b9616c1e7d tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:47.223327 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-be7516e7-5345-4bc1-8871-15b9616c1e7d tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:47.223764 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-be7516e7-5345-4bc1-8871-15b9616c1e7d tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:47.535003 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-29cc3073-bc6c-44d8-a3b8-13205cab644f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:47.545381 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-29cc3073-bc6c-44d8-a3b8-13205cab644f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1259 microversion: 2.1 time: 0.383878 May 26 14:00:47.556436 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 291/622] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:47 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1259 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:47.565499 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-be7516e7-5345-4bc1-8871-15b9616c1e7d tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:47.576633 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-57696579-15aa-45d3-9bd2-3659e081721e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:47.577851 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-57696579-15aa-45d3-9bd2-3659e081721e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:47.581939 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-be7516e7-5345-4bc1-8871-15b9616c1e7d tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1265 microversion: 2.1 time: 0.382769 May 26 14:00:47.588019 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57696579-15aa-45d3-9bd2-3659e081721e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:47.589197 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57696579-15aa-45d3-9bd2-3659e081721e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:47.589431 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57696579-15aa-45d3-9bd2-3659e081721e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:47.589878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57696579-15aa-45d3-9bd2-3659e081721e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:47.594015 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 332/623] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:47 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1265 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:47.685073 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a447b582-1062-49b6-bd0c-c87eb2d3b921 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:47.686717 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a447b582-1062-49b6-bd0c-c87eb2d3b921 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:47.693720 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a447b582-1062-49b6-bd0c-c87eb2d3b921 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:47.694182 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a447b582-1062-49b6-bd0c-c87eb2d3b921 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:47.694999 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a447b582-1062-49b6-bd0c-c87eb2d3b921 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:47.695436 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a447b582-1062-49b6-bd0c-c87eb2d3b921 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:47.820425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-57696579-15aa-45d3-9bd2-3659e081721e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:47.835441 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-57696579-15aa-45d3-9bd2-3659e081721e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1366 microversion: 2.1 time: 0.267515 May 26 14:00:47.838583 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 292/624] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:47 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:47.892693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2841f066-6b08-4639-aa57-437bdf2d3e2c tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:47.898035 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2841f066-6b08-4639-aa57-437bdf2d3e2c tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:47.909608 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2841f066-6b08-4639-aa57-437bdf2d3e2c tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:47.910526 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2841f066-6b08-4639-aa57-437bdf2d3e2c tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:47.911693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2841f066-6b08-4639-aa57-437bdf2d3e2c tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:47.912375 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2841f066-6b08-4639-aa57-437bdf2d3e2c tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:47.957423 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a447b582-1062-49b6-bd0c-c87eb2d3b921 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:47.972422 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a447b582-1062-49b6-bd0c-c87eb2d3b921 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:47.979719 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a447b582-1062-49b6-bd0c-c87eb2d3b921 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:47.985943 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a447b582-1062-49b6-bd0c-c87eb2d3b921 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1740 microversion: 2.20 time: 0.305832 May 26 14:00:47.986710 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 333/625] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:47 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1740 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:00:48.004397 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-148f3694-0b14-443e-9f78-25f50195ae2a req-607e3580-9ac6-428a-a682-c2ed0fb4384c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3aab00-646f-43d0-bc2c-e376b20d7eed", "tag": "fdd5f6ec-fca9-44be-abfa-0f0f6fd34c53"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:00:48.043452 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-148f3694-0b14-443e-9f78-25f50195ae2a req-607e3580-9ac6-428a-a682-c2ed0fb4384c service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:48.050197 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-148f3694-0b14-443e-9f78-25f50195ae2a req-607e3580-9ac6-428a-a682-c2ed0fb4384c service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:48.076480 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-148f3694-0b14-443e-9f78-25f50195ae2a req-607e3580-9ac6-428a-a682-c2ed0fb4384c service nova] Creating event network-changed:fdd5f6ec-fca9-44be-abfa-0f0f6fd34c53 for instance 5f3aab00-646f-43d0-bc2c-e376b20d7eed on hv-cinder-84213 May 26 14:00:48.090658 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-148f3694-0b14-443e-9f78-25f50195ae2a req-607e3580-9ac6-428a-a682-c2ed0fb4384c service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090265 May 26 14:00:48.097701 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 334/626] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:00:48.174583 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2841f066-6b08-4639-aa57-437bdf2d3e2c tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:48.182774 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2841f066-6b08-4639-aa57-437bdf2d3e2c tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1548 microversion: 2.1 time: 0.294493 May 26 14:00:48.183354 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 293/627] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:47 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1548 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:00:48.205327 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-953bbeed-16cb-4b3b-9f23-6f3d83847fb4 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:48.206582 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-953bbeed-16cb-4b3b-9f23-6f3d83847fb4 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:48.221207 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-953bbeed-16cb-4b3b-9f23-6f3d83847fb4 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:48.221726 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-953bbeed-16cb-4b3b-9f23-6f3d83847fb4 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:48.222835 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-953bbeed-16cb-4b3b-9f23-6f3d83847fb4 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:48.223287 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-953bbeed-16cb-4b3b-9f23-6f3d83847fb4 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:48.406840 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-953bbeed-16cb-4b3b-9f23-6f3d83847fb4 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:48.417889 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-953bbeed-16cb-4b3b-9f23-6f3d83847fb4 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1548 microversion: 2.1 time: 0.218719 May 26 14:00:48.418733 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 335/628] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:48 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1548 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:48.433853 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-edb66b81-0a6a-4d9b-baae-8f6e5283afdd tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:48.437631 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-edb66b81-0a6a-4d9b-baae-8f6e5283afdd tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:48.438898 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-edb66b81-0a6a-4d9b-baae-8f6e5283afdd tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Searching by: {'deleted': False, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e'} {{(pid=117787) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 26 14:00:48.447044 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-edb66b81-0a6a-4d9b-baae-8f6e5283afdd tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:48.447730 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-edb66b81-0a6a-4d9b-baae-8f6e5283afdd tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:48.449001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-edb66b81-0a6a-4d9b-baae-8f6e5283afdd tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:48.449651 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-edb66b81-0a6a-4d9b-baae-8f6e5283afdd tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:48.503017 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:48.557478 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.multi_cell_list [None req-edb66b81-0a6a-4d9b-baae-8f6e5283afdd tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117787) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 26 14:00:48.572505 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-41339b41-5d5e-443c-86bc-d27552ce3bda tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:48.573591 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-41339b41-5d5e-443c-86bc-d27552ce3bda tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:48.585827 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-41339b41-5d5e-443c-86bc-d27552ce3bda tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:48.587395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-41339b41-5d5e-443c-86bc-d27552ce3bda tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:48.588193 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-41339b41-5d5e-443c-86bc-d27552ce3bda tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:48.591215 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-41339b41-5d5e-443c-86bc-d27552ce3bda tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:48.702723 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-edb66b81-0a6a-4d9b-baae-8f6e5283afdd tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.271800 May 26 14:00:48.704958 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 294/629] 10.222.0.91 () {58 vars in 1124 bytes} [Thu May 26 14:00:48 2022] GET /compute/v2.1/servers => generated 343 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:00:48.712060 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ea7735fd-b34a-4262-b923-7dbbbc79bc2a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:48.714579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ea7735fd-b34a-4262-b923-7dbbbc79bc2a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:48.729566 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ea7735fd-b34a-4262-b923-7dbbbc79bc2a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:48.730166 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ea7735fd-b34a-4262-b923-7dbbbc79bc2a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:48.731061 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ea7735fd-b34a-4262-b923-7dbbbc79bc2a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:48.731609 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ea7735fd-b34a-4262-b923-7dbbbc79bc2a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:48.774116 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-41339b41-5d5e-443c-86bc-d27552ce3bda tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:48.781940 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-41339b41-5d5e-443c-86bc-d27552ce3bda tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1259 microversion: 2.1 time: 0.214000 May 26 14:00:48.792682 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 336/630] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:48 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1259 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:00:48.798794 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1608876e-a141-4ef4-bc15-cce2cdab3874 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:48.799642 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1608876e-a141-4ef4-bc15-cce2cdab3874 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:48.807494 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1608876e-a141-4ef4-bc15-cce2cdab3874 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:48.808178 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1608876e-a141-4ef4-bc15-cce2cdab3874 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:48.809106 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1608876e-a141-4ef4-bc15-cce2cdab3874 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:48.809726 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1608876e-a141-4ef4-bc15-cce2cdab3874 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:48.976878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ea7735fd-b34a-4262-b923-7dbbbc79bc2a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:48.985960 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ea7735fd-b34a-4262-b923-7dbbbc79bc2a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1265 microversion: 2.1 time: 0.278870 May 26 14:00:48.989676 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 295/631] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:48 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1265 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:48.999569 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b76d1342-d3bc-40c7-aff4-d1b516ca2f0b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:49.000215 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b76d1342-d3bc-40c7-aff4-d1b516ca2f0b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:49.014318 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b76d1342-d3bc-40c7-aff4-d1b516ca2f0b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:49.014784 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b76d1342-d3bc-40c7-aff4-d1b516ca2f0b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:49.015640 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b76d1342-d3bc-40c7-aff4-d1b516ca2f0b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:49.016088 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b76d1342-d3bc-40c7-aff4-d1b516ca2f0b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:49.054659 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1608876e-a141-4ef4-bc15-cce2cdab3874 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:49.070185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1608876e-a141-4ef4-bc15-cce2cdab3874 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1548 microversion: 2.1 time: 0.275297 May 26 14:00:49.079187 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 337/632] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:48 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1548 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:49.091114 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-31926dc7-2287-404c-aaea-9b2fecc0a664 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:49.091948 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-31926dc7-2287-404c-aaea-9b2fecc0a664 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:49.104167 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-31926dc7-2287-404c-aaea-9b2fecc0a664 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:49.104687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-31926dc7-2287-404c-aaea-9b2fecc0a664 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:49.105839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-31926dc7-2287-404c-aaea-9b2fecc0a664 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:49.106488 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-31926dc7-2287-404c-aaea-9b2fecc0a664 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:49.214793 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b76d1342-d3bc-40c7-aff4-d1b516ca2f0b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:49.224394 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b76d1342-d3bc-40c7-aff4-d1b516ca2f0b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1366 microversion: 2.1 time: 0.233593 May 26 14:00:49.225410 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 296/633] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:48 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:49.333841 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-31926dc7-2287-404c-aaea-9b2fecc0a664 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:49.352812 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-31926dc7-2287-404c-aaea-9b2fecc0a664 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:49.354517 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-31926dc7-2287-404c-aaea-9b2fecc0a664 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:49.358033 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-31926dc7-2287-404c-aaea-9b2fecc0a664 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1740 microversion: 2.20 time: 0.284989 May 26 14:00:49.359246 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 338/634] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:49 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1740 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:49.800340 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-02ad7b00-40d3-489a-9011-cd63617253e5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:49.801000 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-02ad7b00-40d3-489a-9011-cd63617253e5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:49.808069 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02ad7b00-40d3-489a-9011-cd63617253e5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:49.808636 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02ad7b00-40d3-489a-9011-cd63617253e5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:49.809527 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02ad7b00-40d3-489a-9011-cd63617253e5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:49.810197 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02ad7b00-40d3-489a-9011-cd63617253e5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:49.958321 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-02ad7b00-40d3-489a-9011-cd63617253e5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:49.966623 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-02ad7b00-40d3-489a-9011-cd63617253e5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1259 microversion: 2.1 time: 0.170213 May 26 14:00:49.967591 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 297/635] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:49 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:50.003790 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2f038e91-0da8-479c-8b91-f6231bd833bb tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:50.004679 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2f038e91-0da8-479c-8b91-f6231bd833bb tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:50.013734 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2f038e91-0da8-479c-8b91-f6231bd833bb tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:50.014403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2f038e91-0da8-479c-8b91-f6231bd833bb tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:50.018586 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2f038e91-0da8-479c-8b91-f6231bd833bb tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:50.019379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2f038e91-0da8-479c-8b91-f6231bd833bb tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:50.166405 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2f038e91-0da8-479c-8b91-f6231bd833bb tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:50.176788 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2f038e91-0da8-479c-8b91-f6231bd833bb tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1265 microversion: 2.1 time: 0.175391 May 26 14:00:50.185196 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 339/636] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:49 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:50.241904 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-21fc3edb-7f96-4ef4-a0b7-e3550b285268 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:50.242603 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-21fc3edb-7f96-4ef4-a0b7-e3550b285268 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:50.254236 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-21fc3edb-7f96-4ef4-a0b7-e3550b285268 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:50.254685 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-21fc3edb-7f96-4ef4-a0b7-e3550b285268 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:50.255453 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-21fc3edb-7f96-4ef4-a0b7-e3550b285268 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:50.256066 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-21fc3edb-7f96-4ef4-a0b7-e3550b285268 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:50.376823 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6879d1c8-c3cc-4c9e-976e-ce7b5d1c112e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:50.379418 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6879d1c8-c3cc-4c9e-976e-ce7b5d1c112e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:50.390758 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6879d1c8-c3cc-4c9e-976e-ce7b5d1c112e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:50.391519 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6879d1c8-c3cc-4c9e-976e-ce7b5d1c112e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:50.392358 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6879d1c8-c3cc-4c9e-976e-ce7b5d1c112e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:50.392771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6879d1c8-c3cc-4c9e-976e-ce7b5d1c112e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:50.418060 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-21fc3edb-7f96-4ef4-a0b7-e3550b285268 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:50.431353 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-21fc3edb-7f96-4ef4-a0b7-e3550b285268 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1557 microversion: 2.1 time: 0.193440 May 26 14:00:50.444702 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 298/637] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:50 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1557 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:00:50.456928 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-09ab1d1d-6187-4a8a-8b85-6708718597c7 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:50.457565 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-09ab1d1d-6187-4a8a-8b85-6708718597c7 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:50.464500 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09ab1d1d-6187-4a8a-8b85-6708718597c7 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:50.464959 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09ab1d1d-6187-4a8a-8b85-6708718597c7 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:50.465785 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09ab1d1d-6187-4a8a-8b85-6708718597c7 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:50.466229 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09ab1d1d-6187-4a8a-8b85-6708718597c7 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:50.607732 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-09ab1d1d-6187-4a8a-8b85-6708718597c7 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.159946 May 26 14:00:50.608554 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 299/638] 10.222.0.91 () {58 vars in 1274 bytes} [Thu May 26 14:00:50 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0/os-interface => generated 285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:00:50.658964 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6879d1c8-c3cc-4c9e-976e-ce7b5d1c112e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:50.669076 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6879d1c8-c3cc-4c9e-976e-ce7b5d1c112e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:50.670730 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6879d1c8-c3cc-4c9e-976e-ce7b5d1c112e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:50.672029 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6879d1c8-c3cc-4c9e-976e-ce7b5d1c112e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1740 microversion: 2.20 time: 0.299320 May 26 14:00:50.672996 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 340/639] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:50 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1740 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:50.984221 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bfc0b49b-c998-441d-bbf1-7bcd90941efb tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:50.985282 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bfc0b49b-c998-441d-bbf1-7bcd90941efb tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:50.999003 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bfc0b49b-c998-441d-bbf1-7bcd90941efb tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:50.999651 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bfc0b49b-c998-441d-bbf1-7bcd90941efb tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:51.001546 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bfc0b49b-c998-441d-bbf1-7bcd90941efb tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:51.002263 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bfc0b49b-c998-441d-bbf1-7bcd90941efb tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:51.192327 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9e9b34be-8872-4406-81d0-82f53048d18a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:51.192850 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9e9b34be-8872-4406-81d0-82f53048d18a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:51.200122 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bfc0b49b-c998-441d-bbf1-7bcd90941efb tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:51.211202 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9e9b34be-8872-4406-81d0-82f53048d18a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:51.211657 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9e9b34be-8872-4406-81d0-82f53048d18a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:51.212428 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9e9b34be-8872-4406-81d0-82f53048d18a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:51.212859 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9e9b34be-8872-4406-81d0-82f53048d18a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:51.218423 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bfc0b49b-c998-441d-bbf1-7bcd90941efb tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1259 microversion: 2.1 time: 0.228907 May 26 14:00:51.226688 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 300/640] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:50 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1259 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:51.407367 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9e9b34be-8872-4406-81d0-82f53048d18a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:51.417076 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9e9b34be-8872-4406-81d0-82f53048d18a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1265 microversion: 2.1 time: 0.228662 May 26 14:00:51.428037 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 341/641] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:51 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:51.693760 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7ea93ea5-c979-49cb-8ffb-b4abf4587e16 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:51.695183 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7ea93ea5-c979-49cb-8ffb-b4abf4587e16 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:51.710118 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7ea93ea5-c979-49cb-8ffb-b4abf4587e16 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:51.710819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7ea93ea5-c979-49cb-8ffb-b4abf4587e16 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:51.720431 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7ea93ea5-c979-49cb-8ffb-b4abf4587e16 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:51.721397 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7ea93ea5-c979-49cb-8ffb-b4abf4587e16 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:51.813092 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-eeafb1c8-4f23-4f83-80f9-b4b52c396f45 req-9f5ffcfb-da66-447a-b38e-57ee7ca4c347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40c8745d-a394-4026-a5c4-b5ce4c5590e0", "tag": "3d450e70-f1c7-407d-adbd-6d7812d913c3"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:00:51.839432 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-eeafb1c8-4f23-4f83-80f9-b4b52c396f45 req-9f5ffcfb-da66-447a-b38e-57ee7ca4c347 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:51.839880 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-eeafb1c8-4f23-4f83-80f9-b4b52c396f45 req-9f5ffcfb-da66-447a-b38e-57ee7ca4c347 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:51.859666 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-eeafb1c8-4f23-4f83-80f9-b4b52c396f45 req-9f5ffcfb-da66-447a-b38e-57ee7ca4c347 service nova] Creating event network-changed:3d450e70-f1c7-407d-adbd-6d7812d913c3 for instance 40c8745d-a394-4026-a5c4-b5ce4c5590e0 on hv-cinder-84213 May 26 14:00:51.875030 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-eeafb1c8-4f23-4f83-80f9-b4b52c396f45 req-9f5ffcfb-da66-447a-b38e-57ee7ca4c347 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065496 May 26 14:00:51.884114 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 342/642] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:00:51.971120 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7ea93ea5-c979-49cb-8ffb-b4abf4587e16 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:51.982593 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7ea93ea5-c979-49cb-8ffb-b4abf4587e16 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:51.984628 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7ea93ea5-c979-49cb-8ffb-b4abf4587e16 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:51.986381 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7ea93ea5-c979-49cb-8ffb-b4abf4587e16 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1740 microversion: 2.20 time: 0.296973 May 26 14:00:51.987387 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 301/643] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:51 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1740 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:52.016665 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f6bd6f21-5eb3-4870-8c09-ffa3d93729f5 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b53b7164-a300-44cd-bbbc-d376586f885e"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:00:52.017858 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f6bd6f21-5eb3-4870-8c09-ffa3d93729f5 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:52.025392 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f6bd6f21-5eb3-4870-8c09-ffa3d93729f5 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:52.026090 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f6bd6f21-5eb3-4870-8c09-ffa3d93729f5 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:52.027037 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f6bd6f21-5eb3-4870-8c09-ffa3d93729f5 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:52.027632 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f6bd6f21-5eb3-4870-8c09-ffa3d93729f5 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:52.234376 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-81aabaab-f4d9-4c34-8391-a05576b59268 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:52.236286 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-81aabaab-f4d9-4c34-8391-a05576b59268 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:52.243770 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-81aabaab-f4d9-4c34-8391-a05576b59268 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:52.244575 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-81aabaab-f4d9-4c34-8391-a05576b59268 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:52.245907 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-81aabaab-f4d9-4c34-8391-a05576b59268 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:52.247197 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-81aabaab-f4d9-4c34-8391-a05576b59268 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:52.447245 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-81aabaab-f4d9-4c34-8391-a05576b59268 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:52.465445 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-81aabaab-f4d9-4c34-8391-a05576b59268 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1259 microversion: 2.1 time: 0.234439 May 26 14:00:52.466495 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 302/644] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:52 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1259 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:52.474975 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-27b739b3-4b5c-453a-bc46-ef30ba5d7fe9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:52.475777 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-27b739b3-4b5c-453a-bc46-ef30ba5d7fe9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:52.482570 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-27b739b3-4b5c-453a-bc46-ef30ba5d7fe9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:52.483261 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-27b739b3-4b5c-453a-bc46-ef30ba5d7fe9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:52.484224 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-27b739b3-4b5c-453a-bc46-ef30ba5d7fe9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:52.486848 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-27b739b3-4b5c-453a-bc46-ef30ba5d7fe9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:52.731954 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-27b739b3-4b5c-453a-bc46-ef30ba5d7fe9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:52.744160 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-27b739b3-4b5c-453a-bc46-ef30ba5d7fe9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1265 microversion: 2.1 time: 0.275975 May 26 14:00:52.757680 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 303/645] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:52 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1265 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:52.777915 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f6bd6f21-5eb3-4870-8c09-ffa3d93729f5 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "POST /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.764199 May 26 14:00:52.780745 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 343/646] 10.222.0.91 () {60 vars in 1322 bytes} [Thu May 26 14:00:52 2022] POST /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b/os-volume_attachments => generated 194 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:00:53.007260 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b247fd0c-2075-4f24-9acf-15435807a02a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:53.007899 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b247fd0c-2075-4f24-9acf-15435807a02a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:53.017592 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b247fd0c-2075-4f24-9acf-15435807a02a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:53.018297 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b247fd0c-2075-4f24-9acf-15435807a02a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:53.019248 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b247fd0c-2075-4f24-9acf-15435807a02a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:53.019848 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b247fd0c-2075-4f24-9acf-15435807a02a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:53.187509 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b247fd0c-2075-4f24-9acf-15435807a02a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:53.194717 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b247fd0c-2075-4f24-9acf-15435807a02a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:53.196930 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b247fd0c-2075-4f24-9acf-15435807a02a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:53.198572 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b247fd0c-2075-4f24-9acf-15435807a02a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1740 microversion: 2.20 time: 0.196310 May 26 14:00:53.199587 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 304/647] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:53 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:53.483867 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-eaa6855d-7e4e-4480-a566-66c50184dbf7 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:53.484570 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-eaa6855d-7e4e-4480-a566-66c50184dbf7 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:53.494509 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eaa6855d-7e4e-4480-a566-66c50184dbf7 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:53.494980 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eaa6855d-7e4e-4480-a566-66c50184dbf7 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:53.495841 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eaa6855d-7e4e-4480-a566-66c50184dbf7 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:53.496216 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eaa6855d-7e4e-4480-a566-66c50184dbf7 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:53.521754 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:53.651932 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-eaa6855d-7e4e-4480-a566-66c50184dbf7 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:53.660347 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-eaa6855d-7e4e-4480-a566-66c50184dbf7 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1259 microversion: 2.1 time: 0.180582 May 26 14:00:53.670315 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 344/648] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:53 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1259 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:53.763205 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ccb66275-cf0f-40c7-be28-f00648a620fa tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:53.764441 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ccb66275-cf0f-40c7-be28-f00648a620fa tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:53.772231 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ccb66275-cf0f-40c7-be28-f00648a620fa tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:53.772987 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ccb66275-cf0f-40c7-be28-f00648a620fa tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:53.774397 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ccb66275-cf0f-40c7-be28-f00648a620fa tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:53.775037 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ccb66275-cf0f-40c7-be28-f00648a620fa tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:53.962783 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ccb66275-cf0f-40c7-be28-f00648a620fa tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:53.972892 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ccb66275-cf0f-40c7-be28-f00648a620fa tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1265 microversion: 2.1 time: 0.214436 May 26 14:00:53.974576 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 305/649] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:53 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:54.219664 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ef010dd2-d9a7-40b4-acdb-1198519e577a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:54.220356 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ef010dd2-d9a7-40b4-acdb-1198519e577a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:54.229060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ef010dd2-d9a7-40b4-acdb-1198519e577a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:54.229547 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ef010dd2-d9a7-40b4-acdb-1198519e577a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:54.230619 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ef010dd2-d9a7-40b4-acdb-1198519e577a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:54.231378 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ef010dd2-d9a7-40b4-acdb-1198519e577a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:54.412045 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ef010dd2-d9a7-40b4-acdb-1198519e577a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:54.420585 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ef010dd2-d9a7-40b4-acdb-1198519e577a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:54.422136 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ef010dd2-d9a7-40b4-acdb-1198519e577a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:54.423321 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ef010dd2-d9a7-40b4-acdb-1198519e577a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1740 microversion: 2.20 time: 0.209958 May 26 14:00:54.423854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 345/650] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:54 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:54.687071 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5796882b-7455-4c81-9bf9-4b7a3a003495 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:54.688000 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5796882b-7455-4c81-9bf9-4b7a3a003495 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:54.695267 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5796882b-7455-4c81-9bf9-4b7a3a003495 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:54.696479 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5796882b-7455-4c81-9bf9-4b7a3a003495 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:54.697546 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5796882b-7455-4c81-9bf9-4b7a3a003495 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:54.698138 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5796882b-7455-4c81-9bf9-4b7a3a003495 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:54.855749 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5796882b-7455-4c81-9bf9-4b7a3a003495 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:54.864677 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5796882b-7455-4c81-9bf9-4b7a3a003495 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1259 microversion: 2.1 time: 0.190848 May 26 14:00:54.865301 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 306/651] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:54 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:54.990493 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-82b6f075-c24a-401c-8c54-1453a49c8afd tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:54.991385 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-82b6f075-c24a-401c-8c54-1453a49c8afd tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:54.998168 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-82b6f075-c24a-401c-8c54-1453a49c8afd tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:54.998886 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-82b6f075-c24a-401c-8c54-1453a49c8afd tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:54.999664 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-82b6f075-c24a-401c-8c54-1453a49c8afd tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:55.000099 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-82b6f075-c24a-401c-8c54-1453a49c8afd tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:55.152926 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-82b6f075-c24a-401c-8c54-1453a49c8afd tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:55.161512 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-82b6f075-c24a-401c-8c54-1453a49c8afd tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1265 microversion: 2.1 time: 0.175519 May 26 14:00:55.162087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 346/652] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:54 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:55.441923 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5bf8f2a5-89fe-4e1e-8529-dead845b9e6c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:55.442521 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5bf8f2a5-89fe-4e1e-8529-dead845b9e6c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:55.449970 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5bf8f2a5-89fe-4e1e-8529-dead845b9e6c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:55.450938 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5bf8f2a5-89fe-4e1e-8529-dead845b9e6c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:55.451982 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5bf8f2a5-89fe-4e1e-8529-dead845b9e6c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:55.452794 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5bf8f2a5-89fe-4e1e-8529-dead845b9e6c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:55.625900 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5bf8f2a5-89fe-4e1e-8529-dead845b9e6c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:55.635590 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5bf8f2a5-89fe-4e1e-8529-dead845b9e6c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:55.638093 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5bf8f2a5-89fe-4e1e-8529-dead845b9e6c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:55.639463 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5bf8f2a5-89fe-4e1e-8529-dead845b9e6c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1740 microversion: 2.20 time: 0.201461 May 26 14:00:55.640546 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 307/653] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:55 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:55.740797 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-d1b90904-17f3-47a4-8de8-3f1609047787 req-23d35a11-9f02-4cbd-96c4-0e591685fe59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4176fdc7-3ccd-4093-b4c4-841eafb524f7", "name": "network-vif-plugged", "status": "completed", "tag": "7d604ff9-6337-4905-bd16-e0eb02d19035"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:00:55.752592 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-d1b90904-17f3-47a4-8de8-3f1609047787 req-23d35a11-9f02-4cbd-96c4-0e591685fe59 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:55.753535 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-d1b90904-17f3-47a4-8de8-3f1609047787 req-23d35a11-9f02-4cbd-96c4-0e591685fe59 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:55.767646 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-d1b90904-17f3-47a4-8de8-3f1609047787 req-23d35a11-9f02-4cbd-96c4-0e591685fe59 service nova] Creating event network-vif-plugged:7d604ff9-6337-4905-bd16-e0eb02d19035 for instance 4176fdc7-3ccd-4093-b4c4-841eafb524f7 on hv-cinder-84213 May 26 14:00:55.774847 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-d1b90904-17f3-47a4-8de8-3f1609047787 req-23d35a11-9f02-4cbd-96c4-0e591685fe59 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038212 May 26 14:00:55.775574 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 347/654] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:00:55.882412 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-71fbf5b7-40a7-4290-953f-2334d6da7ed8 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:55.883583 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-71fbf5b7-40a7-4290-953f-2334d6da7ed8 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:55.891748 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-71fbf5b7-40a7-4290-953f-2334d6da7ed8 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:55.892215 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-71fbf5b7-40a7-4290-953f-2334d6da7ed8 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:55.893452 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-71fbf5b7-40a7-4290-953f-2334d6da7ed8 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:55.894051 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-71fbf5b7-40a7-4290-953f-2334d6da7ed8 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:56.071540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-71fbf5b7-40a7-4290-953f-2334d6da7ed8 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:56.079888 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-71fbf5b7-40a7-4290-953f-2334d6da7ed8 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1259 microversion: 2.1 time: 0.201373 May 26 14:00:56.082858 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 308/655] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:55 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1259 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:56.185694 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-183d5d71-d771-43d1-a491-f6777a5616bd tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:56.187110 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-183d5d71-d771-43d1-a491-f6777a5616bd tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:56.202107 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-183d5d71-d771-43d1-a491-f6777a5616bd tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:56.202850 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-183d5d71-d771-43d1-a491-f6777a5616bd tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:56.213663 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-183d5d71-d771-43d1-a491-f6777a5616bd tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:56.214421 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-183d5d71-d771-43d1-a491-f6777a5616bd tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:56.377636 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-183d5d71-d771-43d1-a491-f6777a5616bd tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:56.386339 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-183d5d71-d771-43d1-a491-f6777a5616bd tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1265 microversion: 2.1 time: 0.210224 May 26 14:00:56.386910 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 348/656] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:56 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:56.658824 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b6628b96-4fd3-4c4e-bd12-3eb749ad4e6e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:56.660057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b6628b96-4fd3-4c4e-bd12-3eb749ad4e6e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:56.667176 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b6628b96-4fd3-4c4e-bd12-3eb749ad4e6e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:56.667951 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b6628b96-4fd3-4c4e-bd12-3eb749ad4e6e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:56.669003 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b6628b96-4fd3-4c4e-bd12-3eb749ad4e6e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:56.669776 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b6628b96-4fd3-4c4e-bd12-3eb749ad4e6e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:56.825977 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b6628b96-4fd3-4c4e-bd12-3eb749ad4e6e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:56.834987 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b6628b96-4fd3-4c4e-bd12-3eb749ad4e6e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:56.837108 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b6628b96-4fd3-4c4e-bd12-3eb749ad4e6e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:56.838889 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b6628b96-4fd3-4c4e-bd12-3eb749ad4e6e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1740 microversion: 2.20 time: 0.183308 May 26 14:00:56.849291 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 309/657] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:56 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:57.095909 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c1ec7211-3b7f-428e-bd1b-014b04af5437 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:57.096521 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c1ec7211-3b7f-428e-bd1b-014b04af5437 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:57.104327 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c1ec7211-3b7f-428e-bd1b-014b04af5437 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:57.104779 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c1ec7211-3b7f-428e-bd1b-014b04af5437 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:57.105786 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c1ec7211-3b7f-428e-bd1b-014b04af5437 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:57.106619 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c1ec7211-3b7f-428e-bd1b-014b04af5437 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:57.290907 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c1ec7211-3b7f-428e-bd1b-014b04af5437 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:57.299844 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c1ec7211-3b7f-428e-bd1b-014b04af5437 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1259 microversion: 2.1 time: 0.207834 May 26 14:00:57.301186 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 349/658] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:57 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1259 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:57.406655 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-75b06d44-1209-4476-b1c8-dc500859b70b tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:57.407242 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-75b06d44-1209-4476-b1c8-dc500859b70b tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:57.415596 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-75b06d44-1209-4476-b1c8-dc500859b70b tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:57.416053 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-75b06d44-1209-4476-b1c8-dc500859b70b tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:57.416854 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-75b06d44-1209-4476-b1c8-dc500859b70b tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:57.417593 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-75b06d44-1209-4476-b1c8-dc500859b70b tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:57.582678 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-75b06d44-1209-4476-b1c8-dc500859b70b tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:57.587632 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:57.594404 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-75b06d44-1209-4476-b1c8-dc500859b70b tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1265 microversion: 2.1 time: 0.192964 May 26 14:00:57.598793 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 310/659] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:57 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:57.857883 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-bae40715-1315-4c57-98c2-cbdccdb4b2e9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:57.859051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-bae40715-1315-4c57-98c2-cbdccdb4b2e9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:57.865346 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bae40715-1315-4c57-98c2-cbdccdb4b2e9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:57.865871 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bae40715-1315-4c57-98c2-cbdccdb4b2e9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:57.866712 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bae40715-1315-4c57-98c2-cbdccdb4b2e9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:57.867247 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bae40715-1315-4c57-98c2-cbdccdb4b2e9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:58.021481 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bae40715-1315-4c57-98c2-cbdccdb4b2e9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:58.030577 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bae40715-1315-4c57-98c2-cbdccdb4b2e9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:58.032203 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bae40715-1315-4c57-98c2-cbdccdb4b2e9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:58.033539 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-bae40715-1315-4c57-98c2-cbdccdb4b2e9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1740 microversion: 2.20 time: 0.181415 May 26 14:00:58.034656 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 350/660] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:57 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:58.315877 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6343750d-bae1-436e-813e-2a26748f65d2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:58.316466 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6343750d-bae1-436e-813e-2a26748f65d2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:58.325327 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6343750d-bae1-436e-813e-2a26748f65d2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:58.326584 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6343750d-bae1-436e-813e-2a26748f65d2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:58.327369 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6343750d-bae1-436e-813e-2a26748f65d2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:58.327807 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6343750d-bae1-436e-813e-2a26748f65d2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:58.467164 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6343750d-bae1-436e-813e-2a26748f65d2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:58.474882 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6343750d-bae1-436e-813e-2a26748f65d2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1259 microversion: 2.1 time: 0.162974 May 26 14:00:58.475448 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 311/661] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:58 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:00:58.611743 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f08444c2-a3f3-4323-94fe-cb2633687b93 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:58.612330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f08444c2-a3f3-4323-94fe-cb2633687b93 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:58.619330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f08444c2-a3f3-4323-94fe-cb2633687b93 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:58.619780 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f08444c2-a3f3-4323-94fe-cb2633687b93 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:58.620642 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f08444c2-a3f3-4323-94fe-cb2633687b93 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:58.621082 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f08444c2-a3f3-4323-94fe-cb2633687b93 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:58.752998 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f08444c2-a3f3-4323-94fe-cb2633687b93 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:58.760360 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f08444c2-a3f3-4323-94fe-cb2633687b93 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1265 microversion: 2.1 time: 0.152478 May 26 14:00:58.760926 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 351/662] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:58 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:59.052068 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1f496863-5c17-4074-af7d-d18e2aec02ff tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:59.052868 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1f496863-5c17-4074-af7d-d18e2aec02ff tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:59.055213 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:59.060855 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1f496863-5c17-4074-af7d-d18e2aec02ff tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:59.061371 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1f496863-5c17-4074-af7d-d18e2aec02ff tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:59.062417 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1f496863-5c17-4074-af7d-d18e2aec02ff tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:59.062886 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1f496863-5c17-4074-af7d-d18e2aec02ff tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:59.195170 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1f496863-5c17-4074-af7d-d18e2aec02ff tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:59.203802 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1f496863-5c17-4074-af7d-d18e2aec02ff tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:59.205329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1f496863-5c17-4074-af7d-d18e2aec02ff tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:59.206493 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1f496863-5c17-4074-af7d-d18e2aec02ff tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1740 microversion: 2.20 time: 0.158431 May 26 14:00:59.207060 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 312/663] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:00:59 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:00:59.491772 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-51197080-4a6d-4c20-8603-d1a7438ef087 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:59.492869 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-51197080-4a6d-4c20-8603-d1a7438ef087 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:59.499076 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-51197080-4a6d-4c20-8603-d1a7438ef087 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:59.499526 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-51197080-4a6d-4c20-8603-d1a7438ef087 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:59.500294 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-51197080-4a6d-4c20-8603-d1a7438ef087 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:59.500727 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-51197080-4a6d-4c20-8603-d1a7438ef087 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:59.629604 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-51197080-4a6d-4c20-8603-d1a7438ef087 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:59.637494 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-51197080-4a6d-4c20-8603-d1a7438ef087 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1444 microversion: 2.1 time: 0.149632 May 26 14:00:59.638065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 352/664] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:59 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1444 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:59.653580 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6de87f87-e9df-4ea2-8bda-a939828bd54f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:59.654194 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6de87f87-e9df-4ea2-8bda-a939828bd54f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:59.660583 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6de87f87-e9df-4ea2-8bda-a939828bd54f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:59.661037 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6de87f87-e9df-4ea2-8bda-a939828bd54f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:59.661850 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6de87f87-e9df-4ea2-8bda-a939828bd54f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:59.662312 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6de87f87-e9df-4ea2-8bda-a939828bd54f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:59.777437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0c8f5afc-faa9-4b61-b9f6-da2e72daba7e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:59.778053 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0c8f5afc-faa9-4b61-b9f6-da2e72daba7e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:59.784011 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0c8f5afc-faa9-4b61-b9f6-da2e72daba7e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:59.784462 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0c8f5afc-faa9-4b61-b9f6-da2e72daba7e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:59.785278 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0c8f5afc-faa9-4b61-b9f6-da2e72daba7e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:59.785717 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0c8f5afc-faa9-4b61-b9f6-da2e72daba7e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:59.792990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6de87f87-e9df-4ea2-8bda-a939828bd54f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:59.800567 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6de87f87-e9df-4ea2-8bda-a939828bd54f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1444 microversion: 2.1 time: 0.150832 May 26 14:00:59.801245 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 313/665] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:59 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:59.931668 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0c8f5afc-faa9-4b61-b9f6-da2e72daba7e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:59.939326 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0c8f5afc-faa9-4b61-b9f6-da2e72daba7e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1265 microversion: 2.1 time: 0.165832 May 26 14:00:59.940069 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 353/666] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:00:59 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:01:00.224910 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-929c37f1-c912-4c36-8f93-6aa8dbcad125 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:00.225553 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-929c37f1-c912-4c36-8f93-6aa8dbcad125 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:00.232177 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-929c37f1-c912-4c36-8f93-6aa8dbcad125 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:00.232630 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-929c37f1-c912-4c36-8f93-6aa8dbcad125 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:00.233427 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-929c37f1-c912-4c36-8f93-6aa8dbcad125 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:00.233862 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-929c37f1-c912-4c36-8f93-6aa8dbcad125 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:00.375454 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-929c37f1-c912-4c36-8f93-6aa8dbcad125 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:00.383936 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-929c37f1-c912-4c36-8f93-6aa8dbcad125 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:00.385406 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-929c37f1-c912-4c36-8f93-6aa8dbcad125 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:00.386581 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-929c37f1-c912-4c36-8f93-6aa8dbcad125 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1740 microversion: 2.20 time: 0.165536 May 26 14:01:00.387141 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 314/667] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:00 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:00.956448 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4d89641a-cb4b-4fc4-9b1a-5be539c832b3 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:00.957175 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4d89641a-cb4b-4fc4-9b1a-5be539c832b3 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:00.964022 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4d89641a-cb4b-4fc4-9b1a-5be539c832b3 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:00.964713 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4d89641a-cb4b-4fc4-9b1a-5be539c832b3 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:00.965528 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4d89641a-cb4b-4fc4-9b1a-5be539c832b3 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:00.966114 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4d89641a-cb4b-4fc4-9b1a-5be539c832b3 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:01.099896 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4d89641a-cb4b-4fc4-9b1a-5be539c832b3 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:01.107559 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4d89641a-cb4b-4fc4-9b1a-5be539c832b3 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1265 microversion: 2.1 time: 0.155068 May 26 14:01:01.108140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 354/668] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:01:00 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:01.408726 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1d1d8008-5f04-4b9b-9318-f1e7fa243824 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:01.408726 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1d1d8008-5f04-4b9b-9318-f1e7fa243824 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:01.410941 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d1d8008-5f04-4b9b-9318-f1e7fa243824 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:01.411395 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d1d8008-5f04-4b9b-9318-f1e7fa243824 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:01.412154 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d1d8008-5f04-4b9b-9318-f1e7fa243824 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:01.412586 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d1d8008-5f04-4b9b-9318-f1e7fa243824 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:01.552663 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1d1d8008-5f04-4b9b-9318-f1e7fa243824 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:01.562489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1d1d8008-5f04-4b9b-9318-f1e7fa243824 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:01.564706 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1d1d8008-5f04-4b9b-9318-f1e7fa243824 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:01.566158 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1d1d8008-5f04-4b9b-9318-f1e7fa243824 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1722 microversion: 2.20 time: 0.166325 May 26 14:01:01.567055 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 315/669] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:01 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:01.588550 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-59dbfd33-9453-4188-9ff9-5abf968469af req-b89f3b95-cb5c-4598-8c12-0beac90c4538 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4176fdc7-3ccd-4093-b4c4-841eafb524f7", "tag": "7d604ff9-6337-4905-bd16-e0eb02d19035"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:01:01.596502 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-59dbfd33-9453-4188-9ff9-5abf968469af req-b89f3b95-cb5c-4598-8c12-0beac90c4538 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:01.597167 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-59dbfd33-9453-4188-9ff9-5abf968469af req-b89f3b95-cb5c-4598-8c12-0beac90c4538 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:01.608840 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-59dbfd33-9453-4188-9ff9-5abf968469af req-b89f3b95-cb5c-4598-8c12-0beac90c4538 service nova] Creating event network-changed:7d604ff9-6337-4905-bd16-e0eb02d19035 for instance 4176fdc7-3ccd-4093-b4c4-841eafb524f7 on hv-cinder-84213 May 26 14:01:01.615040 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-59dbfd33-9453-4188-9ff9-5abf968469af req-b89f3b95-cb5c-4598-8c12-0beac90c4538 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031050 May 26 14:01:01.615634 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 355/670] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:01:02.128561 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d02a6327-945b-4593-9dd3-7f7a4ef1b204 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:02.129187 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d02a6327-945b-4593-9dd3-7f7a4ef1b204 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:02.135702 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d02a6327-945b-4593-9dd3-7f7a4ef1b204 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:02.136154 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d02a6327-945b-4593-9dd3-7f7a4ef1b204 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:02.136934 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d02a6327-945b-4593-9dd3-7f7a4ef1b204 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:02.137398 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d02a6327-945b-4593-9dd3-7f7a4ef1b204 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:02.266492 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d02a6327-945b-4593-9dd3-7f7a4ef1b204 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:02.274956 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d02a6327-945b-4593-9dd3-7f7a4ef1b204 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1265 microversion: 2.1 time: 0.151134 May 26 14:01:02.275521 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 316/671] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:01:02 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:02.584777 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0b8a232d-2b5a-491f-a809-18d2bcca552c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:02.585499 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0b8a232d-2b5a-491f-a809-18d2bcca552c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:02.592447 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0b8a232d-2b5a-491f-a809-18d2bcca552c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:02.592895 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0b8a232d-2b5a-491f-a809-18d2bcca552c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:02.593686 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0b8a232d-2b5a-491f-a809-18d2bcca552c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:02.594124 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0b8a232d-2b5a-491f-a809-18d2bcca552c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:02.728291 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0b8a232d-2b5a-491f-a809-18d2bcca552c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:02.736199 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0b8a232d-2b5a-491f-a809-18d2bcca552c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:02.737713 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0b8a232d-2b5a-491f-a809-18d2bcca552c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:02.738975 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0b8a232d-2b5a-491f-a809-18d2bcca552c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1722 microversion: 2.20 time: 0.158931 May 26 14:01:02.739531 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 356/672] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:02 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:03.292986 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-60be239d-9549-432e-84aa-ec5ac3f940d9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:03.294091 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-60be239d-9549-432e-84aa-ec5ac3f940d9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:03.303472 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-60be239d-9549-432e-84aa-ec5ac3f940d9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:03.304017 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-60be239d-9549-432e-84aa-ec5ac3f940d9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:03.305478 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-60be239d-9549-432e-84aa-ec5ac3f940d9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:03.306062 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-60be239d-9549-432e-84aa-ec5ac3f940d9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:03.577935 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-60be239d-9549-432e-84aa-ec5ac3f940d9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:03.596248 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-60be239d-9549-432e-84aa-ec5ac3f940d9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1265 microversion: 2.1 time: 0.307642 May 26 14:01:03.597742 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 317/673] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:01:03 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1265 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:01:03.694623 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-12150452-2e3a-4adb-a98b-84c30d559c23 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:03.695295 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-12150452-2e3a-4adb-a98b-84c30d559c23 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:03.701990 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-12150452-2e3a-4adb-a98b-84c30d559c23 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:03.702432 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-12150452-2e3a-4adb-a98b-84c30d559c23 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:03.703212 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-12150452-2e3a-4adb-a98b-84c30d559c23 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:03.703647 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-12150452-2e3a-4adb-a98b-84c30d559c23 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:03.757841 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bc9447bf-830d-49c1-bc18-286264376384 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:03.758378 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bc9447bf-830d-49c1-bc18-286264376384 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:03.765112 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bc9447bf-830d-49c1-bc18-286264376384 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:03.765608 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bc9447bf-830d-49c1-bc18-286264376384 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:03.766420 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bc9447bf-830d-49c1-bc18-286264376384 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:03.766925 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bc9447bf-830d-49c1-bc18-286264376384 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:03.883756 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-12150452-2e3a-4adb-a98b-84c30d559c23 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:03.893062 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-12150452-2e3a-4adb-a98b-84c30d559c23 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1594 microversion: 2.1 time: 0.201623 May 26 14:01:03.893646 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 357/674] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:01:03 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1594 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:03.927679 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-22a0661a-cdc4-4f2d-bbb9-ee840a5279e1 req-a28afad8-46d4-44b6-9654-8e08a566dd07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9116ee60-50e6-48c5-bcc1-8e9d08e35458", "name": "network-vif-unplugged", "status": "completed", "tag": "0d486a1e-7691-438f-a89c-df9425b682f1"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:01:03.941378 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-22a0661a-cdc4-4f2d-bbb9-ee840a5279e1 req-a28afad8-46d4-44b6-9654-8e08a566dd07 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:03.941832 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-22a0661a-cdc4-4f2d-bbb9-ee840a5279e1 req-a28afad8-46d4-44b6-9654-8e08a566dd07 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:03.960252 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-22a0661a-cdc4-4f2d-bbb9-ee840a5279e1 req-a28afad8-46d4-44b6-9654-8e08a566dd07 service nova] Creating event network-vif-unplugged:0d486a1e-7691-438f-a89c-df9425b682f1 for instance 9116ee60-50e6-48c5-bcc1-8e9d08e35458 on hv-cinder-84213 May 26 14:01:03.964896 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bc9447bf-830d-49c1-bc18-286264376384 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:03.978375 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bc9447bf-830d-49c1-bc18-286264376384 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:03.980196 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bc9447bf-830d-49c1-bc18-286264376384 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:03.982101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bc9447bf-830d-49c1-bc18-286264376384 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1722 microversion: 2.20 time: 0.228215 May 26 14:01:03.982928 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-22a0661a-cdc4-4f2d-bbb9-ee840a5279e1 req-a28afad8-46d4-44b6-9654-8e08a566dd07 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060540 May 26 14:01:03.983339 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 318/675] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:03 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:01:03.990145 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 358/676] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:01:04.614228 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-31f6835c-04bb-415d-8b90-c90076ab35de tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:04.614840 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-31f6835c-04bb-415d-8b90-c90076ab35de tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:04.622802 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-31f6835c-04bb-415d-8b90-c90076ab35de tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:04.623287 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-31f6835c-04bb-415d-8b90-c90076ab35de tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:04.625640 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-31f6835c-04bb-415d-8b90-c90076ab35de tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:04.626067 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-31f6835c-04bb-415d-8b90-c90076ab35de tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:04.759870 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-31f6835c-04bb-415d-8b90-c90076ab35de tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:04.767395 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-31f6835c-04bb-415d-8b90-c90076ab35de tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1265 microversion: 2.1 time: 0.157198 May 26 14:01:04.768039 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 319/677] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:01:04 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:05.002830 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-bc1b9e88-51ab-45dd-b906-1cd8bf2f9649 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:05.004292 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-bc1b9e88-51ab-45dd-b906-1cd8bf2f9649 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:05.011271 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bc1b9e88-51ab-45dd-b906-1cd8bf2f9649 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:05.011720 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bc1b9e88-51ab-45dd-b906-1cd8bf2f9649 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:05.012516 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bc1b9e88-51ab-45dd-b906-1cd8bf2f9649 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:05.012947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bc1b9e88-51ab-45dd-b906-1cd8bf2f9649 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:05.203218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bc1b9e88-51ab-45dd-b906-1cd8bf2f9649 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:05.211668 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bc1b9e88-51ab-45dd-b906-1cd8bf2f9649 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:05.213201 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bc1b9e88-51ab-45dd-b906-1cd8bf2f9649 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:05.214361 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-bc1b9e88-51ab-45dd-b906-1cd8bf2f9649 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1722 microversion: 2.20 time: 0.216915 May 26 14:01:05.214914 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 359/678] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:04 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:05.784522 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4e6a5339-ccfe-48be-a89c-dd1190ac00c7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:05.785347 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4e6a5339-ccfe-48be-a89c-dd1190ac00c7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:05.792425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4e6a5339-ccfe-48be-a89c-dd1190ac00c7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:05.792930 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4e6a5339-ccfe-48be-a89c-dd1190ac00c7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:05.793732 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4e6a5339-ccfe-48be-a89c-dd1190ac00c7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:05.794173 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4e6a5339-ccfe-48be-a89c-dd1190ac00c7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:05.960243 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4e6a5339-ccfe-48be-a89c-dd1190ac00c7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:05.971984 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4e6a5339-ccfe-48be-a89c-dd1190ac00c7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1265 microversion: 2.1 time: 0.190968 May 26 14:01:05.973970 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 320/679] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:01:05 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:06.014724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-a995c284-b78a-490c-882a-ea5562e01110 req-ea0877f0-8314-4959-b7be-3b3c91131723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dddc973-36be-43e2-8971-e5e218dee91b", "tag": "c3710695-2c7b-4d4d-96bc-de38e27dc865"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:01:06.032462 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-a995c284-b78a-490c-882a-ea5562e01110 req-ea0877f0-8314-4959-b7be-3b3c91131723 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:06.033398 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-a995c284-b78a-490c-882a-ea5562e01110 req-ea0877f0-8314-4959-b7be-3b3c91131723 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:06.047704 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-a995c284-b78a-490c-882a-ea5562e01110 req-ea0877f0-8314-4959-b7be-3b3c91131723 service nova] Creating event network-changed:c3710695-2c7b-4d4d-96bc-de38e27dc865 for instance 5dddc973-36be-43e2-8971-e5e218dee91b on hv-cinder-84213 May 26 14:01:06.053756 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-a995c284-b78a-490c-882a-ea5562e01110 req-ea0877f0-8314-4959-b7be-3b3c91131723 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046391 May 26 14:01:06.055454 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 360/680] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:01:06.232434 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4dbebed0-8235-48f2-80c6-42d83d1734a0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:06.233380 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4dbebed0-8235-48f2-80c6-42d83d1734a0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:06.241108 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4dbebed0-8235-48f2-80c6-42d83d1734a0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:06.241933 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4dbebed0-8235-48f2-80c6-42d83d1734a0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:06.243345 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4dbebed0-8235-48f2-80c6-42d83d1734a0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:06.243953 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4dbebed0-8235-48f2-80c6-42d83d1734a0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:06.407549 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4dbebed0-8235-48f2-80c6-42d83d1734a0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:06.416407 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4dbebed0-8235-48f2-80c6-42d83d1734a0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:06.417963 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4dbebed0-8235-48f2-80c6-42d83d1734a0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:06.419297 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4dbebed0-8235-48f2-80c6-42d83d1734a0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1725 microversion: 2.20 time: 0.190761 May 26 14:01:06.419853 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 321/681] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:06 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:06.437779 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-20f5ec79-946b-42ef-8d04-bb19db985a72 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73c6de89-2c31-4db8-a60b-be5650ecc312"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:01:06.439317 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-20f5ec79-946b-42ef-8d04-bb19db985a72 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:06.447098 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-20f5ec79-946b-42ef-8d04-bb19db985a72 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:06.447644 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-20f5ec79-946b-42ef-8d04-bb19db985a72 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:06.448793 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-20f5ec79-946b-42ef-8d04-bb19db985a72 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:06.449334 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-20f5ec79-946b-42ef-8d04-bb19db985a72 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:06.711482 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:06.833489 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-20f5ec79-946b-42ef-8d04-bb19db985a72 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "POST /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.399950 May 26 14:01:06.834668 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 361/682] 10.222.0.91 () {62 vars in 1363 bytes} [Thu May 26 14:01:06 2022] POST /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/os-volume_attachments => generated 188 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:01:06.986249 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e2c8e56b-c600-4708-a272-0ce49447d407 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:01:06.986962 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e2c8e56b-c600-4708-a272-0ce49447d407 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:06.990528 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6e09dbaf-f9d8-49d0-a66f-c30e2dddd8eb tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:06.993071 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6e09dbaf-f9d8-49d0-a66f-c30e2dddd8eb tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:06.995491 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e2c8e56b-c600-4708-a272-0ce49447d407 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:06.995998 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e2c8e56b-c600-4708-a272-0ce49447d407 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:06.996974 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e2c8e56b-c600-4708-a272-0ce49447d407 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:06.997762 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e2c8e56b-c600-4708-a272-0ce49447d407 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:07.005837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6e09dbaf-f9d8-49d0-a66f-c30e2dddd8eb tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:07.006540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6e09dbaf-f9d8-49d0-a66f-c30e2dddd8eb tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:07.009161 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6e09dbaf-f9d8-49d0-a66f-c30e2dddd8eb tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:07.010809 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6e09dbaf-f9d8-49d0-a66f-c30e2dddd8eb tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:07.210519 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e2c8e56b-c600-4708-a272-0ce49447d407 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "POST /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/action" status: 202 len: 0 microversion: 2.20 time: 0.226523 May 26 14:01:07.218501 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 322/683] 10.222.0.91 () {62 vars in 1318 bytes} [Thu May 26 14:01:06 2022] POST /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 14:01:07.229973 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-856eb32a-0046-49af-ba50-efc0a02952a9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:07.230596 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-856eb32a-0046-49af-ba50-efc0a02952a9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:07.247837 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-856eb32a-0046-49af-ba50-efc0a02952a9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:07.248189 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-856eb32a-0046-49af-ba50-efc0a02952a9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:07.252647 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-856eb32a-0046-49af-ba50-efc0a02952a9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:07.253174 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-856eb32a-0046-49af-ba50-efc0a02952a9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:07.309098 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6e09dbaf-f9d8-49d0-a66f-c30e2dddd8eb tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:07.319828 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6e09dbaf-f9d8-49d0-a66f-c30e2dddd8eb tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1265 microversion: 2.1 time: 0.333012 May 26 14:01:07.321185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 362/684] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:01:06 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1265 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:01:07.400019 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-e4e5be08-5fa7-4d6a-87da-68d1700587ed req-bc061ccd-0f2a-4ceb-b9ab-096d791c04e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3aab00-646f-43d0-bc2c-e376b20d7eed", "name": "network-vif-plugged", "status": "completed", "tag": "fdd5f6ec-fca9-44be-abfa-0f0f6fd34c53"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:01:07.418637 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-e4e5be08-5fa7-4d6a-87da-68d1700587ed req-bc061ccd-0f2a-4ceb-b9ab-096d791c04e0 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:07.419001 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-e4e5be08-5fa7-4d6a-87da-68d1700587ed req-bc061ccd-0f2a-4ceb-b9ab-096d791c04e0 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:07.455867 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-e4e5be08-5fa7-4d6a-87da-68d1700587ed req-bc061ccd-0f2a-4ceb-b9ab-096d791c04e0 service nova] Creating event network-vif-plugged:fdd5f6ec-fca9-44be-abfa-0f0f6fd34c53 for instance 5f3aab00-646f-43d0-bc2c-e376b20d7eed on hv-cinder-84213 May 26 14:01:07.463724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-e4e5be08-5fa7-4d6a-87da-68d1700587ed req-bc061ccd-0f2a-4ceb-b9ab-096d791c04e0 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068990 May 26 14:01:07.464640 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 363/685] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:01:07.493282 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-856eb32a-0046-49af-ba50-efc0a02952a9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:07.507833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-856eb32a-0046-49af-ba50-efc0a02952a9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:07.509801 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-856eb32a-0046-49af-ba50-efc0a02952a9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:07.511231 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-856eb32a-0046-49af-ba50-efc0a02952a9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1751 microversion: 2.20 time: 0.291360 May 26 14:01:07.524278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 323/686] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:07 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1751 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:07.808515 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c797f22d-8a3c-4600-a5e5-f128bfec86e8 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-674567016"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:01:07.809136 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c797f22d-8a3c-4600-a5e5-f128bfec86e8 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:07.815397 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c797f22d-8a3c-4600-a5e5-f128bfec86e8 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:07.815848 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c797f22d-8a3c-4600-a5e5-f128bfec86e8 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:07.816681 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c797f22d-8a3c-4600-a5e5-f128bfec86e8 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:07.817118 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c797f22d-8a3c-4600-a5e5-f128bfec86e8 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:07.967258 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.network.security_group_api [None req-c797f22d-8a3c-4600-a5e5-f128bfec86e8 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Adding security group 94740b1a-7284-42d2-9e19-eb1e58806f3b to port c3710695-2c7b-4d4d-96bc-de38e27dc865 May 26 14:01:08.337424 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e59053dd-6a28-41aa-8615-76f963a52158 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:08.338038 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e59053dd-6a28-41aa-8615-76f963a52158 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:08.344797 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e59053dd-6a28-41aa-8615-76f963a52158 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:08.345280 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e59053dd-6a28-41aa-8615-76f963a52158 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:08.346060 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e59053dd-6a28-41aa-8615-76f963a52158 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:08.346496 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e59053dd-6a28-41aa-8615-76f963a52158 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:08.371970 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c797f22d-8a3c-4600-a5e5-f128bfec86e8 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "POST /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b/action" status: 202 len: 0 microversion: 2.1 time: 0.567950 May 26 14:01:08.373560 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 364/687] 10.222.0.91 () {60 vars in 1277 bytes} [Thu May 26 14:01:07 2022] POST /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b/action => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:01:08.385468 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7acf0c70-9d97-4675-a89d-1481f5deb749 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:08.386600 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7acf0c70-9d97-4675-a89d-1481f5deb749 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:08.396333 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7acf0c70-9d97-4675-a89d-1481f5deb749 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:08.397328 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7acf0c70-9d97-4675-a89d-1481f5deb749 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:08.398217 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7acf0c70-9d97-4675-a89d-1481f5deb749 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:08.398669 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7acf0c70-9d97-4675-a89d-1481f5deb749 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:08.577448 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e59053dd-6a28-41aa-8615-76f963a52158 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:08.587569 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e59053dd-6a28-41aa-8615-76f963a52158 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1265 microversion: 2.1 time: 0.253905 May 26 14:01:08.589414 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 324/688] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:01:08 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:08.595312 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-f2178ce2-3bf4-4a35-acfc-eccff9b68b0a req-6f72e708-952f-4b0c-b139-0b9f98442488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dddc973-36be-43e2-8971-e5e218dee91b", "tag": "c3710695-2c7b-4d4d-96bc-de38e27dc865"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:01:08.599814 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7acf0c70-9d97-4675-a89d-1481f5deb749 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:08.605709 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-f2178ce2-3bf4-4a35-acfc-eccff9b68b0a req-6f72e708-952f-4b0c-b139-0b9f98442488 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:08.606145 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-f2178ce2-3bf4-4a35-acfc-eccff9b68b0a req-6f72e708-952f-4b0c-b139-0b9f98442488 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:08.608839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7acf0c70-9d97-4675-a89d-1481f5deb749 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1759 microversion: 2.1 time: 0.230854 May 26 14:01:08.609454 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 365/689] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:01:08 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1759 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:08.614919 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-70a02894-53ce-42ba-95dd-be31ec4ae231 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:08.615521 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-70a02894-53ce-42ba-95dd-be31ec4ae231 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:08.618578 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-f2178ce2-3bf4-4a35-acfc-eccff9b68b0a req-6f72e708-952f-4b0c-b139-0b9f98442488 service nova] Creating event network-changed:c3710695-2c7b-4d4d-96bc-de38e27dc865 for instance 5dddc973-36be-43e2-8971-e5e218dee91b on hv-cinder-84213 May 26 14:01:08.622769 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-70a02894-53ce-42ba-95dd-be31ec4ae231 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:08.623219 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-70a02894-53ce-42ba-95dd-be31ec4ae231 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:08.624001 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-70a02894-53ce-42ba-95dd-be31ec4ae231 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:08.624433 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-70a02894-53ce-42ba-95dd-be31ec4ae231 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:08.625737 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-f2178ce2-3bf4-4a35-acfc-eccff9b68b0a req-6f72e708-952f-4b0c-b139-0b9f98442488 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034708 May 26 14:01:08.626332 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 325/690] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:01:08.756740 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-70a02894-53ce-42ba-95dd-be31ec4ae231 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:08.766160 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-70a02894-53ce-42ba-95dd-be31ec4ae231 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:08.767898 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-70a02894-53ce-42ba-95dd-be31ec4ae231 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:08.769060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-70a02894-53ce-42ba-95dd-be31ec4ae231 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1751 microversion: 2.20 time: 0.157861 May 26 14:01:08.769675 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 366/691] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:08 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:09.605613 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2713b907-8eb2-47bc-92cc-28e8c9c319e5 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:09.606411 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2713b907-8eb2-47bc-92cc-28e8c9c319e5 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:09.612781 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2713b907-8eb2-47bc-92cc-28e8c9c319e5 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:09.613249 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2713b907-8eb2-47bc-92cc-28e8c9c319e5 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:09.614230 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2713b907-8eb2-47bc-92cc-28e8c9c319e5 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:09.614661 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2713b907-8eb2-47bc-92cc-28e8c9c319e5 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:09.753241 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2713b907-8eb2-47bc-92cc-28e8c9c319e5 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:09.764047 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2713b907-8eb2-47bc-92cc-28e8c9c319e5 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1265 microversion: 2.1 time: 0.163025 May 26 14:01:09.764670 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 326/692] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:01:09 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:09.787809 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-63d5e0e0-a793-447f-b6e2-bba140196a28 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:09.788416 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-63d5e0e0-a793-447f-b6e2-bba140196a28 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:09.794858 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63d5e0e0-a793-447f-b6e2-bba140196a28 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:09.795304 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63d5e0e0-a793-447f-b6e2-bba140196a28 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:09.796062 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63d5e0e0-a793-447f-b6e2-bba140196a28 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:09.796497 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63d5e0e0-a793-447f-b6e2-bba140196a28 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:09.940643 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-63d5e0e0-a793-447f-b6e2-bba140196a28 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:09.952418 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-63d5e0e0-a793-447f-b6e2-bba140196a28 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:09.953936 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-63d5e0e0-a793-447f-b6e2-bba140196a28 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:09.955092 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-63d5e0e0-a793-447f-b6e2-bba140196a28 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1753 microversion: 2.20 time: 0.171234 May 26 14:01:09.955645 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 367/693] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:09 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:10.783403 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d792b312-70e0-4001-bfc4-4f61cf589e14 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:10.783929 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d792b312-70e0-4001-bfc4-4f61cf589e14 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:10.791113 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d792b312-70e0-4001-bfc4-4f61cf589e14 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:10.791567 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d792b312-70e0-4001-bfc4-4f61cf589e14 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:10.792341 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d792b312-70e0-4001-bfc4-4f61cf589e14 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:10.792778 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d792b312-70e0-4001-bfc4-4f61cf589e14 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:10.795542 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:10.921327 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d792b312-70e0-4001-bfc4-4f61cf589e14 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:10.928803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d792b312-70e0-4001-bfc4-4f61cf589e14 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1453 microversion: 2.1 time: 0.149284 May 26 14:01:10.929401 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 327/694] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:01:10 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:10.945302 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9a1b6b26-46b7-4f8b-aeb2-ed047919bd5c tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:10.945901 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9a1b6b26-46b7-4f8b-aeb2-ed047919bd5c tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:10.948281 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:10.953124 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a1b6b26-46b7-4f8b-aeb2-ed047919bd5c tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:10.953590 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a1b6b26-46b7-4f8b-aeb2-ed047919bd5c tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:10.954659 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a1b6b26-46b7-4f8b-aeb2-ed047919bd5c tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:10.955081 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a1b6b26-46b7-4f8b-aeb2-ed047919bd5c tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:10.973682 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d625d8fb-6500-4bdd-ba8b-97464bbacfd2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:10.974670 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d625d8fb-6500-4bdd-ba8b-97464bbacfd2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:10.981653 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d625d8fb-6500-4bdd-ba8b-97464bbacfd2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:10.982104 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d625d8fb-6500-4bdd-ba8b-97464bbacfd2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:10.982918 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d625d8fb-6500-4bdd-ba8b-97464bbacfd2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:10.983356 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d625d8fb-6500-4bdd-ba8b-97464bbacfd2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:11.159084 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9a1b6b26-46b7-4f8b-aeb2-ed047919bd5c tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:11.167190 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9a1b6b26-46b7-4f8b-aeb2-ed047919bd5c tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1453 microversion: 2.1 time: 0.225631 May 26 14:01:11.167775 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 368/695] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:01:10 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1453 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:11.171014 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d625d8fb-6500-4bdd-ba8b-97464bbacfd2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:11.179663 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d625d8fb-6500-4bdd-ba8b-97464bbacfd2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:11.181212 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d625d8fb-6500-4bdd-ba8b-97464bbacfd2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:11.182391 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d625d8fb-6500-4bdd-ba8b-97464bbacfd2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1753 microversion: 2.20 time: 0.212615 May 26 14:01:11.182968 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 328/696] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:10 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1753 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:12.321632 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1e538706-9fd3-4529-88b8-d5e6418fc645 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:12.323030 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1e538706-9fd3-4529-88b8-d5e6418fc645 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:12.331085 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1e538706-9fd3-4529-88b8-d5e6418fc645 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:12.331536 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1e538706-9fd3-4529-88b8-d5e6418fc645 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:12.332306 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1e538706-9fd3-4529-88b8-d5e6418fc645 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:12.332842 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1e538706-9fd3-4529-88b8-d5e6418fc645 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:12.552089 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1e538706-9fd3-4529-88b8-d5e6418fc645 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:12.561873 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1e538706-9fd3-4529-88b8-d5e6418fc645 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:12.563486 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1e538706-9fd3-4529-88b8-d5e6418fc645 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:12.565021 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1e538706-9fd3-4529-88b8-d5e6418fc645 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.368753 May 26 14:01:12.577534 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 369/697] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:12 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:01:13.290392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-5567e42d-299b-4be0-8498-61bccbe0225a req-e16ed375-00b1-456d-b2fd-7248d25b3eea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3aab00-646f-43d0-bc2c-e376b20d7eed", "tag": "fdd5f6ec-fca9-44be-abfa-0f0f6fd34c53"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:01:13.298852 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-5567e42d-299b-4be0-8498-61bccbe0225a req-e16ed375-00b1-456d-b2fd-7248d25b3eea service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:13.299301 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-5567e42d-299b-4be0-8498-61bccbe0225a req-e16ed375-00b1-456d-b2fd-7248d25b3eea service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:13.311151 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-5567e42d-299b-4be0-8498-61bccbe0225a req-e16ed375-00b1-456d-b2fd-7248d25b3eea service nova] Creating event network-changed:fdd5f6ec-fca9-44be-abfa-0f0f6fd34c53 for instance 5f3aab00-646f-43d0-bc2c-e376b20d7eed on hv-cinder-84213 May 26 14:01:13.316578 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-5567e42d-299b-4be0-8498-61bccbe0225a req-e16ed375-00b1-456d-b2fd-7248d25b3eea service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032173 May 26 14:01:13.317209 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 329/698] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:01:13.583820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a76fb1cd-c4ee-4230-877c-e576354d3bcd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:13.584419 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a76fb1cd-c4ee-4230-877c-e576354d3bcd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:13.590848 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a76fb1cd-c4ee-4230-877c-e576354d3bcd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:13.591284 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a76fb1cd-c4ee-4230-877c-e576354d3bcd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:13.592034 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a76fb1cd-c4ee-4230-877c-e576354d3bcd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:13.592460 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a76fb1cd-c4ee-4230-877c-e576354d3bcd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:13.723473 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a76fb1cd-c4ee-4230-877c-e576354d3bcd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:13.732524 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a76fb1cd-c4ee-4230-877c-e576354d3bcd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:13.734052 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a76fb1cd-c4ee-4230-877c-e576354d3bcd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:13.735217 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a76fb1cd-c4ee-4230-877c-e576354d3bcd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.155305 May 26 14:01:13.735778 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 370/699] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:13 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:14.755036 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-35debdd3-6acd-4a76-b7fd-85b25fbc7471 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:14.755731 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-35debdd3-6acd-4a76-b7fd-85b25fbc7471 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:14.762203 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-35debdd3-6acd-4a76-b7fd-85b25fbc7471 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:14.762691 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-35debdd3-6acd-4a76-b7fd-85b25fbc7471 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:14.763470 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-35debdd3-6acd-4a76-b7fd-85b25fbc7471 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:14.763906 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-35debdd3-6acd-4a76-b7fd-85b25fbc7471 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:14.891453 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-35debdd3-6acd-4a76-b7fd-85b25fbc7471 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:14.900548 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-35debdd3-6acd-4a76-b7fd-85b25fbc7471 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:14.902076 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-35debdd3-6acd-4a76-b7fd-85b25fbc7471 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:14.903223 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-35debdd3-6acd-4a76-b7fd-85b25fbc7471 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.153049 May 26 14:01:14.903783 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 330/700] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:14 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:15.922060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d6fc2105-50fa-4120-95a7-b4268dd52d7e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:15.922607 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d6fc2105-50fa-4120-95a7-b4268dd52d7e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:15.929050 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d6fc2105-50fa-4120-95a7-b4268dd52d7e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:15.930093 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d6fc2105-50fa-4120-95a7-b4268dd52d7e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:15.930859 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d6fc2105-50fa-4120-95a7-b4268dd52d7e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:15.931297 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d6fc2105-50fa-4120-95a7-b4268dd52d7e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:16.063409 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d6fc2105-50fa-4120-95a7-b4268dd52d7e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:16.071859 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d6fc2105-50fa-4120-95a7-b4268dd52d7e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:16.073400 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d6fc2105-50fa-4120-95a7-b4268dd52d7e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:16.074554 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d6fc2105-50fa-4120-95a7-b4268dd52d7e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.156535 May 26 14:01:16.075110 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 371/701] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:15 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:17.092585 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a1d04a52-6d49-48e4-839c-c22bc2e55a43 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:17.093206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a1d04a52-6d49-48e4-839c-c22bc2e55a43 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:17.099625 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a1d04a52-6d49-48e4-839c-c22bc2e55a43 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:17.100053 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a1d04a52-6d49-48e4-839c-c22bc2e55a43 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:17.100827 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a1d04a52-6d49-48e4-839c-c22bc2e55a43 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:17.101283 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a1d04a52-6d49-48e4-839c-c22bc2e55a43 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:17.228876 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a1d04a52-6d49-48e4-839c-c22bc2e55a43 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:17.237236 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a1d04a52-6d49-48e4-839c-c22bc2e55a43 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:17.238743 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a1d04a52-6d49-48e4-839c-c22bc2e55a43 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:17.239892 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a1d04a52-6d49-48e4-839c-c22bc2e55a43 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.151158 May 26 14:01:17.240449 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 331/702] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:17 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:18.259313 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8855edae-cf30-4e2d-b892-e600723d8243 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:18.260072 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8855edae-cf30-4e2d-b892-e600723d8243 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:18.266990 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8855edae-cf30-4e2d-b892-e600723d8243 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:18.267362 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8855edae-cf30-4e2d-b892-e600723d8243 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:18.268168 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8855edae-cf30-4e2d-b892-e600723d8243 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:18.268599 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8855edae-cf30-4e2d-b892-e600723d8243 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:18.401734 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8855edae-cf30-4e2d-b892-e600723d8243 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:18.410270 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8855edae-cf30-4e2d-b892-e600723d8243 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:18.411796 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8855edae-cf30-4e2d-b892-e600723d8243 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:18.412948 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8855edae-cf30-4e2d-b892-e600723d8243 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.158200 May 26 14:01:18.413544 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 372/703] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:18 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:19.431549 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cee4659d-2a19-4b2b-a2d9-29b1b2777304 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:19.432163 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cee4659d-2a19-4b2b-a2d9-29b1b2777304 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:19.434762 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=84 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:19.439958 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cee4659d-2a19-4b2b-a2d9-29b1b2777304 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:19.440410 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cee4659d-2a19-4b2b-a2d9-29b1b2777304 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:19.441195 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cee4659d-2a19-4b2b-a2d9-29b1b2777304 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:19.441637 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cee4659d-2a19-4b2b-a2d9-29b1b2777304 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:19.577386 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cee4659d-2a19-4b2b-a2d9-29b1b2777304 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:19.585793 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cee4659d-2a19-4b2b-a2d9-29b1b2777304 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:19.587293 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cee4659d-2a19-4b2b-a2d9-29b1b2777304 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:19.588436 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cee4659d-2a19-4b2b-a2d9-29b1b2777304 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.161288 May 26 14:01:19.588995 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 332/704] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:19 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:20.606677 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-84e036e4-a47a-4f01-8df8-c4aef2886305 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:20.607198 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-84e036e4-a47a-4f01-8df8-c4aef2886305 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:20.614497 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-84e036e4-a47a-4f01-8df8-c4aef2886305 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:20.615051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-84e036e4-a47a-4f01-8df8-c4aef2886305 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:20.616990 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-84e036e4-a47a-4f01-8df8-c4aef2886305 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:20.617655 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-84e036e4-a47a-4f01-8df8-c4aef2886305 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:20.752495 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-84e036e4-a47a-4f01-8df8-c4aef2886305 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:20.761911 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-84e036e4-a47a-4f01-8df8-c4aef2886305 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:20.763407 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-84e036e4-a47a-4f01-8df8-c4aef2886305 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:20.764573 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-84e036e4-a47a-4f01-8df8-c4aef2886305 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.162018 May 26 14:01:20.765118 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 373/705] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:20 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:21.783010 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-066a8f23-0827-46eb-bcf9-7996eaa29f12 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:21.783617 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-066a8f23-0827-46eb-bcf9-7996eaa29f12 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:21.790901 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-066a8f23-0827-46eb-bcf9-7996eaa29f12 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:21.791359 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-066a8f23-0827-46eb-bcf9-7996eaa29f12 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:21.792132 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-066a8f23-0827-46eb-bcf9-7996eaa29f12 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:21.792573 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-066a8f23-0827-46eb-bcf9-7996eaa29f12 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:21.925732 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-066a8f23-0827-46eb-bcf9-7996eaa29f12 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:21.934004 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-066a8f23-0827-46eb-bcf9-7996eaa29f12 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:21.935495 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-066a8f23-0827-46eb-bcf9-7996eaa29f12 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:21.936641 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-066a8f23-0827-46eb-bcf9-7996eaa29f12 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.157579 May 26 14:01:21.937223 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 333/706] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:21 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:01:22.955310 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3c88c1d7-1759-4279-a2bb-b8e2b75f2dc5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:22.955893 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3c88c1d7-1759-4279-a2bb-b8e2b75f2dc5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:22.962422 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c88c1d7-1759-4279-a2bb-b8e2b75f2dc5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:22.962871 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c88c1d7-1759-4279-a2bb-b8e2b75f2dc5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:22.963633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c88c1d7-1759-4279-a2bb-b8e2b75f2dc5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:22.964073 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c88c1d7-1759-4279-a2bb-b8e2b75f2dc5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:23.114114 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3c88c1d7-1759-4279-a2bb-b8e2b75f2dc5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:23.122604 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3c88c1d7-1759-4279-a2bb-b8e2b75f2dc5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:23.124100 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3c88c1d7-1759-4279-a2bb-b8e2b75f2dc5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:23.125290 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3c88c1d7-1759-4279-a2bb-b8e2b75f2dc5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.173874 May 26 14:01:23.126789 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 374/707] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:22 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:24.143625 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ee523b56-ddad-4e63-a666-4a4e5d9cf6bc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:24.144231 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ee523b56-ddad-4e63-a666-4a4e5d9cf6bc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:24.150917 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ee523b56-ddad-4e63-a666-4a4e5d9cf6bc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:24.151369 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ee523b56-ddad-4e63-a666-4a4e5d9cf6bc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:24.152131 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ee523b56-ddad-4e63-a666-4a4e5d9cf6bc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:24.152568 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ee523b56-ddad-4e63-a666-4a4e5d9cf6bc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:24.315199 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ee523b56-ddad-4e63-a666-4a4e5d9cf6bc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:24.323876 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ee523b56-ddad-4e63-a666-4a4e5d9cf6bc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:24.325414 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ee523b56-ddad-4e63-a666-4a4e5d9cf6bc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:24.326565 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ee523b56-ddad-4e63-a666-4a4e5d9cf6bc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.186799 May 26 14:01:24.327127 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 334/708] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:24 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:25.345668 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1bbf3c4c-bf54-483d-866f-3adb9b7a5a1d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:25.346498 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1bbf3c4c-bf54-483d-866f-3adb9b7a5a1d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:25.355391 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1bbf3c4c-bf54-483d-866f-3adb9b7a5a1d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:25.356566 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1bbf3c4c-bf54-483d-866f-3adb9b7a5a1d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:25.357896 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1bbf3c4c-bf54-483d-866f-3adb9b7a5a1d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:25.358603 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1bbf3c4c-bf54-483d-866f-3adb9b7a5a1d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:25.524055 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1bbf3c4c-bf54-483d-866f-3adb9b7a5a1d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:25.532565 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1bbf3c4c-bf54-483d-866f-3adb9b7a5a1d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:25.534101 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1bbf3c4c-bf54-483d-866f-3adb9b7a5a1d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:25.535286 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1bbf3c4c-bf54-483d-866f-3adb9b7a5a1d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.194165 May 26 14:01:25.535851 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 375/709] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:25 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:26.553827 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-efe7e4de-d98f-4ce4-8c3e-3c79c9256689 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:26.554440 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-efe7e4de-d98f-4ce4-8c3e-3c79c9256689 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:26.561010 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-efe7e4de-d98f-4ce4-8c3e-3c79c9256689 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:26.561510 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-efe7e4de-d98f-4ce4-8c3e-3c79c9256689 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:26.562279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-efe7e4de-d98f-4ce4-8c3e-3c79c9256689 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:26.562720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-efe7e4de-d98f-4ce4-8c3e-3c79c9256689 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:26.698646 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-efe7e4de-d98f-4ce4-8c3e-3c79c9256689 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:26.707034 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-efe7e4de-d98f-4ce4-8c3e-3c79c9256689 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:26.708512 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-efe7e4de-d98f-4ce4-8c3e-3c79c9256689 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:26.709684 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-efe7e4de-d98f-4ce4-8c3e-3c79c9256689 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.159737 May 26 14:01:26.710887 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 335/710] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:26 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:27.728239 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-593934dc-3547-4310-81bb-3b9c3def8007 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:27.728824 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-593934dc-3547-4310-81bb-3b9c3def8007 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:27.735065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-593934dc-3547-4310-81bb-3b9c3def8007 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:27.735509 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-593934dc-3547-4310-81bb-3b9c3def8007 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:27.736473 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-593934dc-3547-4310-81bb-3b9c3def8007 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:27.737074 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-593934dc-3547-4310-81bb-3b9c3def8007 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:27.884070 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-593934dc-3547-4310-81bb-3b9c3def8007 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:27.911139 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-593934dc-3547-4310-81bb-3b9c3def8007 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:27.912675 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-593934dc-3547-4310-81bb-3b9c3def8007 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:27.921397 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-593934dc-3547-4310-81bb-3b9c3def8007 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.197246 May 26 14:01:27.921990 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 376/711] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:27 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:28.939640 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4f664715-efdc-4070-9c7a-39dc6befc78d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:28.940255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4f664715-efdc-4070-9c7a-39dc6befc78d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:28.946833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4f664715-efdc-4070-9c7a-39dc6befc78d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:28.947287 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4f664715-efdc-4070-9c7a-39dc6befc78d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:28.948049 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4f664715-efdc-4070-9c7a-39dc6befc78d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:28.948488 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4f664715-efdc-4070-9c7a-39dc6befc78d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:29.078847 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4f664715-efdc-4070-9c7a-39dc6befc78d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:29.088419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4f664715-efdc-4070-9c7a-39dc6befc78d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:29.090238 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4f664715-efdc-4070-9c7a-39dc6befc78d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:29.091409 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4f664715-efdc-4070-9c7a-39dc6befc78d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.155627 May 26 14:01:29.091966 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 336/712] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:28 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:30.110289 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-141d5959-18a6-4d48-aa3f-2f5cc5cba18c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:30.110902 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-141d5959-18a6-4d48-aa3f-2f5cc5cba18c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:30.118152 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-141d5959-18a6-4d48-aa3f-2f5cc5cba18c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:30.118601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-141d5959-18a6-4d48-aa3f-2f5cc5cba18c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:30.119457 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-141d5959-18a6-4d48-aa3f-2f5cc5cba18c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:30.119895 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-141d5959-18a6-4d48-aa3f-2f5cc5cba18c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:30.248743 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-141d5959-18a6-4d48-aa3f-2f5cc5cba18c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:30.257089 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-141d5959-18a6-4d48-aa3f-2f5cc5cba18c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:30.259121 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-141d5959-18a6-4d48-aa3f-2f5cc5cba18c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:30.260272 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-141d5959-18a6-4d48-aa3f-2f5cc5cba18c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.153934 May 26 14:01:30.260834 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 377/713] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:30 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:31.279861 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e68fbae4-c061-4f8c-be00-43fbc01857c8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:31.280612 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e68fbae4-c061-4f8c-be00-43fbc01857c8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:31.288189 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e68fbae4-c061-4f8c-be00-43fbc01857c8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:31.289265 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e68fbae4-c061-4f8c-be00-43fbc01857c8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:31.290078 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e68fbae4-c061-4f8c-be00-43fbc01857c8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:31.290513 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e68fbae4-c061-4f8c-be00-43fbc01857c8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:31.431808 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e68fbae4-c061-4f8c-be00-43fbc01857c8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:31.440840 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e68fbae4-c061-4f8c-be00-43fbc01857c8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:31.442372 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e68fbae4-c061-4f8c-be00-43fbc01857c8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:31.443529 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e68fbae4-c061-4f8c-be00-43fbc01857c8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.168130 May 26 14:01:31.444083 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 337/714] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:31 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:32.461631 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a112ad76-3311-45bd-b2d0-791091dc4d73 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:32.462314 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a112ad76-3311-45bd-b2d0-791091dc4d73 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:32.468852 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a112ad76-3311-45bd-b2d0-791091dc4d73 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:32.469910 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a112ad76-3311-45bd-b2d0-791091dc4d73 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:32.470052 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a112ad76-3311-45bd-b2d0-791091dc4d73 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:32.470439 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a112ad76-3311-45bd-b2d0-791091dc4d73 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:32.610171 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a112ad76-3311-45bd-b2d0-791091dc4d73 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:32.612496 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:32.620346 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a112ad76-3311-45bd-b2d0-791091dc4d73 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:32.621896 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a112ad76-3311-45bd-b2d0-791091dc4d73 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:32.623238 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a112ad76-3311-45bd-b2d0-791091dc4d73 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.165483 May 26 14:01:32.623800 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 378/715] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:32 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:33.641513 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c453a403-2461-4f3d-856b-27a4ce539c07 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:33.642148 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c453a403-2461-4f3d-856b-27a4ce539c07 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:33.650225 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c453a403-2461-4f3d-856b-27a4ce539c07 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:33.650675 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c453a403-2461-4f3d-856b-27a4ce539c07 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:33.651452 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c453a403-2461-4f3d-856b-27a4ce539c07 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:33.651886 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c453a403-2461-4f3d-856b-27a4ce539c07 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:33.803484 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c453a403-2461-4f3d-856b-27a4ce539c07 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:33.814852 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c453a403-2461-4f3d-856b-27a4ce539c07 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:33.816884 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c453a403-2461-4f3d-856b-27a4ce539c07 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:33.818359 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c453a403-2461-4f3d-856b-27a4ce539c07 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.180697 May 26 14:01:33.819985 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 338/716] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:33 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:34.838436 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8ca50eb1-a44a-4c2c-a70e-d225135b35c7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:34.839064 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8ca50eb1-a44a-4c2c-a70e-d225135b35c7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:34.845943 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8ca50eb1-a44a-4c2c-a70e-d225135b35c7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:34.846433 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8ca50eb1-a44a-4c2c-a70e-d225135b35c7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:34.847262 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8ca50eb1-a44a-4c2c-a70e-d225135b35c7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:34.847695 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8ca50eb1-a44a-4c2c-a70e-d225135b35c7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:34.974126 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8ca50eb1-a44a-4c2c-a70e-d225135b35c7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:34.983162 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8ca50eb1-a44a-4c2c-a70e-d225135b35c7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:34.984663 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8ca50eb1-a44a-4c2c-a70e-d225135b35c7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:34.985850 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8ca50eb1-a44a-4c2c-a70e-d225135b35c7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.152178 May 26 14:01:34.986416 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 379/717] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:34 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:36.004197 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4ca8b5f7-428a-41ba-8a3f-5d8c2f1fbac4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:36.004805 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4ca8b5f7-428a-41ba-8a3f-5d8c2f1fbac4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:36.011348 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4ca8b5f7-428a-41ba-8a3f-5d8c2f1fbac4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:36.011798 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4ca8b5f7-428a-41ba-8a3f-5d8c2f1fbac4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:36.012558 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4ca8b5f7-428a-41ba-8a3f-5d8c2f1fbac4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:36.012989 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4ca8b5f7-428a-41ba-8a3f-5d8c2f1fbac4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:36.142648 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4ca8b5f7-428a-41ba-8a3f-5d8c2f1fbac4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:36.151814 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4ca8b5f7-428a-41ba-8a3f-5d8c2f1fbac4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:36.153422 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4ca8b5f7-428a-41ba-8a3f-5d8c2f1fbac4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:36.154578 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4ca8b5f7-428a-41ba-8a3f-5d8c2f1fbac4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.154253 May 26 14:01:36.155132 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 339/718] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:35 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:37.172403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-14452b4e-35b4-49b2-8aa5-dcb6d82f47d4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:37.172939 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-14452b4e-35b4-49b2-8aa5-dcb6d82f47d4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:37.180041 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-14452b4e-35b4-49b2-8aa5-dcb6d82f47d4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:37.180492 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-14452b4e-35b4-49b2-8aa5-dcb6d82f47d4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:37.181279 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-14452b4e-35b4-49b2-8aa5-dcb6d82f47d4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:37.181715 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-14452b4e-35b4-49b2-8aa5-dcb6d82f47d4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:37.312812 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-14452b4e-35b4-49b2-8aa5-dcb6d82f47d4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:37.321785 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-14452b4e-35b4-49b2-8aa5-dcb6d82f47d4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:37.323270 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-14452b4e-35b4-49b2-8aa5-dcb6d82f47d4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:37.324415 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-14452b4e-35b4-49b2-8aa5-dcb6d82f47d4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.156088 May 26 14:01:37.324967 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 380/719] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:37 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:38.343553 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7c887dc8-6a39-496d-b0e1-1875f55d0653 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:38.344247 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7c887dc8-6a39-496d-b0e1-1875f55d0653 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:38.352312 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7c887dc8-6a39-496d-b0e1-1875f55d0653 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:38.352758 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7c887dc8-6a39-496d-b0e1-1875f55d0653 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:38.353568 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7c887dc8-6a39-496d-b0e1-1875f55d0653 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:38.353996 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7c887dc8-6a39-496d-b0e1-1875f55d0653 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:38.492894 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7c887dc8-6a39-496d-b0e1-1875f55d0653 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:38.502388 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7c887dc8-6a39-496d-b0e1-1875f55d0653 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:38.503227 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7c887dc8-6a39-496d-b0e1-1875f55d0653 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:38.504399 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7c887dc8-6a39-496d-b0e1-1875f55d0653 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.165835 May 26 14:01:38.504965 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 340/720] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:38 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:39.528408 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-eff12b5c-18f7-4a80-a569-c87b676bfaff tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:39.528943 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-eff12b5c-18f7-4a80-a569-c87b676bfaff tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:39.535767 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eff12b5c-18f7-4a80-a569-c87b676bfaff tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:39.536233 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eff12b5c-18f7-4a80-a569-c87b676bfaff tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:39.536999 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eff12b5c-18f7-4a80-a569-c87b676bfaff tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:39.537474 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eff12b5c-18f7-4a80-a569-c87b676bfaff tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:39.670442 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-eff12b5c-18f7-4a80-a569-c87b676bfaff tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:39.678977 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-eff12b5c-18f7-4a80-a569-c87b676bfaff tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:39.680535 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-eff12b5c-18f7-4a80-a569-c87b676bfaff tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:39.681725 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-eff12b5c-18f7-4a80-a569-c87b676bfaff tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.157334 May 26 14:01:39.682286 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 381/721] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:39 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:40.699860 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-05858c81-bcce-48b4-872b-abd6ad67998d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:40.700475 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-05858c81-bcce-48b4-872b-abd6ad67998d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:40.707081 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05858c81-bcce-48b4-872b-abd6ad67998d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:40.707527 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05858c81-bcce-48b4-872b-abd6ad67998d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:40.708319 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05858c81-bcce-48b4-872b-abd6ad67998d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:40.708753 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05858c81-bcce-48b4-872b-abd6ad67998d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:40.836553 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-05858c81-bcce-48b4-872b-abd6ad67998d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:40.838729 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=84 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:40.846235 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-05858c81-bcce-48b4-872b-abd6ad67998d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:40.847734 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-05858c81-bcce-48b4-872b-abd6ad67998d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:40.848886 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-05858c81-bcce-48b4-872b-abd6ad67998d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.153046 May 26 14:01:40.849469 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 341/722] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:40 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:41.867981 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8b3bf459-7999-4c06-9d0a-4af2d65b6b18 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:41.868588 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8b3bf459-7999-4c06-9d0a-4af2d65b6b18 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:41.871013 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=28 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:41.876739 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8b3bf459-7999-4c06-9d0a-4af2d65b6b18 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:41.877206 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8b3bf459-7999-4c06-9d0a-4af2d65b6b18 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:41.877977 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8b3bf459-7999-4c06-9d0a-4af2d65b6b18 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:41.878414 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8b3bf459-7999-4c06-9d0a-4af2d65b6b18 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:42.011988 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8b3bf459-7999-4c06-9d0a-4af2d65b6b18 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:42.020407 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8b3bf459-7999-4c06-9d0a-4af2d65b6b18 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:42.022200 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8b3bf459-7999-4c06-9d0a-4af2d65b6b18 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:42.023356 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8b3bf459-7999-4c06-9d0a-4af2d65b6b18 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.159845 May 26 14:01:42.023921 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 382/723] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:41 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:43.041590 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d33864bc-1ab5-4408-ae8f-2e71f843b02d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:43.042189 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d33864bc-1ab5-4408-ae8f-2e71f843b02d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:43.049191 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d33864bc-1ab5-4408-ae8f-2e71f843b02d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:43.049632 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d33864bc-1ab5-4408-ae8f-2e71f843b02d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:43.050402 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d33864bc-1ab5-4408-ae8f-2e71f843b02d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:43.050833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d33864bc-1ab5-4408-ae8f-2e71f843b02d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:43.188013 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d33864bc-1ab5-4408-ae8f-2e71f843b02d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:43.197036 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d33864bc-1ab5-4408-ae8f-2e71f843b02d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:43.198589 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d33864bc-1ab5-4408-ae8f-2e71f843b02d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:43.199740 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d33864bc-1ab5-4408-ae8f-2e71f843b02d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.162027 May 26 14:01:43.200359 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 342/724] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:43 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:44.217896 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-878b2c66-b1d5-4110-8425-f6d3f07eebe3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:44.218505 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-878b2c66-b1d5-4110-8425-f6d3f07eebe3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:44.225111 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-878b2c66-b1d5-4110-8425-f6d3f07eebe3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:44.226333 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-878b2c66-b1d5-4110-8425-f6d3f07eebe3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:44.226979 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-878b2c66-b1d5-4110-8425-f6d3f07eebe3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:44.227420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-878b2c66-b1d5-4110-8425-f6d3f07eebe3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:44.374049 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-878b2c66-b1d5-4110-8425-f6d3f07eebe3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:44.384466 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-878b2c66-b1d5-4110-8425-f6d3f07eebe3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:44.386017 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-878b2c66-b1d5-4110-8425-f6d3f07eebe3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:44.387267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-878b2c66-b1d5-4110-8425-f6d3f07eebe3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.173234 May 26 14:01:44.388219 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 383/725] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:44 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:45.406152 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-12030217-728d-41f4-8984-ca5f1d6599e6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:45.406715 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-12030217-728d-41f4-8984-ca5f1d6599e6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:45.412902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-12030217-728d-41f4-8984-ca5f1d6599e6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:45.413870 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-12030217-728d-41f4-8984-ca5f1d6599e6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:45.414690 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-12030217-728d-41f4-8984-ca5f1d6599e6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:45.415132 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-12030217-728d-41f4-8984-ca5f1d6599e6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:45.555270 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-12030217-728d-41f4-8984-ca5f1d6599e6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:45.563921 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-12030217-728d-41f4-8984-ca5f1d6599e6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:45.565372 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-12030217-728d-41f4-8984-ca5f1d6599e6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:45.566519 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-12030217-728d-41f4-8984-ca5f1d6599e6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.164435 May 26 14:01:45.567075 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 343/726] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:45 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:45.576785 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-203e1306-37a3-46e1-a1f1-69e4769ad6f7 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1473801658", "imageRef": "bcaacfae-fe2c-455f-a6e1-b08361c6fa8c", "flavorRef": "452", "networks": [{"uuid": "bbfc7162-50f8-45cc-990c-7477113944aa"}]}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:01:45.629278 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-203e1306-37a3-46e1-a1f1-69e4769ad6f7 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] validate_networks() for [('bbfc7162-50f8-45cc-990c-7477113944aa', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 14:01:46.010121 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-203e1306-37a3-46e1-a1f1-69e4769ad6f7 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 14:01:46.010539 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-203e1306-37a3-46e1-a1f1-69e4769ad6f7 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 14:01:46.011006 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-203e1306-37a3-46e1-a1f1-69e4769ad6f7 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 14:01:46.011416 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-203e1306-37a3-46e1-a1f1-69e4769ad6f7 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 14:01:46.011820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-203e1306-37a3-46e1-a1f1-69e4769ad6f7 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 14:01:46.020607 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-203e1306-37a3-46e1-a1f1-69e4769ad6f7 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:46.021345 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-203e1306-37a3-46e1-a1f1-69e4769ad6f7 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:46.022143 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-203e1306-37a3-46e1-a1f1-69e4769ad6f7 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:46.023203 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-203e1306-37a3-46e1-a1f1-69e4769ad6f7 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:46.039437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-203e1306-37a3-46e1-a1f1-69e4769ad6f7 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Getting quotas for project 98a1b861d3d84f309ff5a1e90f7499fd. Resources: {'ram', 'cores', 'instances'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 14:01:46.043387 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-203e1306-37a3-46e1-a1f1-69e4769ad6f7 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Getting quotas for user d3425e6afcbf4d20bf4229ba6d93c8ff and project 98a1b861d3d84f309ff5a1e90f7499fd. Resources: {'ram', 'cores', 'instances'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 14:01:46.054200 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-203e1306-37a3-46e1-a1f1-69e4769ad6f7 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 14:01:46.056494 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-203e1306-37a3-46e1-a1f1-69e4769ad6f7 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 92878816-6457-4392-b0bc-fb172b09fb2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bcaacfae-fe2c-455f-a6e1-b08361c6fa8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 14:01:46.100684 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-203e1306-37a3-46e1-a1f1-69e4769ad6f7 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527719 May 26 14:01:46.101348 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 384/727] 10.222.0.91 () {60 vars in 1146 bytes} [Thu May 26 14:01:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 14:01:46.111243 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ff694114-94f9-45de-9f6e-60a376e6c16c tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:46.111855 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ff694114-94f9-45de-9f6e-60a376e6c16c tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 92878816-6457-4392-b0bc-fb172b09fb2c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:46.165215 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ff694114-94f9-45de-9f6e-60a376e6c16c tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:46.172080 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ff694114-94f9-45de-9f6e-60a376e6c16c tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c" status: 200 len: 1219 microversion: 2.1 time: 0.064554 May 26 14:01:46.172656 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 344/728] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:01:46 2022] GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:46.585180 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ce76ebd1-419e-4ff5-83af-10f718ebd3c9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:46.585794 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ce76ebd1-419e-4ff5-83af-10f718ebd3c9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:46.593042 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ce76ebd1-419e-4ff5-83af-10f718ebd3c9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:46.593512 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ce76ebd1-419e-4ff5-83af-10f718ebd3c9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:46.594419 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ce76ebd1-419e-4ff5-83af-10f718ebd3c9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:46.594722 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ce76ebd1-419e-4ff5-83af-10f718ebd3c9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:46.748616 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ce76ebd1-419e-4ff5-83af-10f718ebd3c9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:46.757052 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ce76ebd1-419e-4ff5-83af-10f718ebd3c9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:46.758589 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ce76ebd1-419e-4ff5-83af-10f718ebd3c9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:46.759744 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ce76ebd1-419e-4ff5-83af-10f718ebd3c9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.178745 May 26 14:01:46.760307 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 385/729] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:46 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:47.188760 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-be591ee5-fc6b-4e51-a438-399e45aa9538 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:47.189426 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-be591ee5-fc6b-4e51-a438-399e45aa9538 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 92878816-6457-4392-b0bc-fb172b09fb2c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:47.196512 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-be591ee5-fc6b-4e51-a438-399e45aa9538 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:47.197525 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-be591ee5-fc6b-4e51-a438-399e45aa9538 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:47.197756 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-be591ee5-fc6b-4e51-a438-399e45aa9538 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:47.198194 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-be591ee5-fc6b-4e51-a438-399e45aa9538 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:47.275881 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-be591ee5-fc6b-4e51-a438-399e45aa9538 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:47.286334 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-be591ee5-fc6b-4e51-a438-399e45aa9538 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c" status: 200 len: 1279 microversion: 2.1 time: 0.101321 May 26 14:01:47.287565 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 345/730] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:01:47 2022] GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c => generated 1279 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:47.777979 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c68fb4f1-5bf4-4dcd-9ca1-2e669752ee69 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:47.778695 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c68fb4f1-5bf4-4dcd-9ca1-2e669752ee69 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:47.785104 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c68fb4f1-5bf4-4dcd-9ca1-2e669752ee69 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:47.785589 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c68fb4f1-5bf4-4dcd-9ca1-2e669752ee69 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:47.786351 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c68fb4f1-5bf4-4dcd-9ca1-2e669752ee69 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:47.786780 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c68fb4f1-5bf4-4dcd-9ca1-2e669752ee69 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:47.937808 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c68fb4f1-5bf4-4dcd-9ca1-2e669752ee69 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:47.947664 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c68fb4f1-5bf4-4dcd-9ca1-2e669752ee69 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:47.949485 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c68fb4f1-5bf4-4dcd-9ca1-2e669752ee69 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:47.951112 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c68fb4f1-5bf4-4dcd-9ca1-2e669752ee69 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.177075 May 26 14:01:47.951715 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 386/731] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:47 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:48.305464 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-13543dcd-c5a5-420d-8fbb-a2163cf90e4b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:48.306373 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-13543dcd-c5a5-420d-8fbb-a2163cf90e4b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 92878816-6457-4392-b0bc-fb172b09fb2c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:48.313218 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-13543dcd-c5a5-420d-8fbb-a2163cf90e4b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:48.313754 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-13543dcd-c5a5-420d-8fbb-a2163cf90e4b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:48.314533 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-13543dcd-c5a5-420d-8fbb-a2163cf90e4b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:48.314968 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-13543dcd-c5a5-420d-8fbb-a2163cf90e4b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:48.446179 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-13543dcd-c5a5-420d-8fbb-a2163cf90e4b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:48.453648 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-13543dcd-c5a5-420d-8fbb-a2163cf90e4b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c" status: 200 len: 1319 microversion: 2.1 time: 0.152690 May 26 14:01:48.454336 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 346/732] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:01:48 2022] GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:48.693512 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-93f26751-5ed2-4033-ab0d-64bcd3a75f20 req-04ff6c1f-af97-4a70-94d1-596ca411bb68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92878816-6457-4392-b0bc-fb172b09fb2c", "tag": "34f5dafc-2456-45ca-8aa3-b0e00e47f747"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:01:48.703489 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-93f26751-5ed2-4033-ab0d-64bcd3a75f20 req-04ff6c1f-af97-4a70-94d1-596ca411bb68 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:48.703958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-93f26751-5ed2-4033-ab0d-64bcd3a75f20 req-04ff6c1f-af97-4a70-94d1-596ca411bb68 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:48.716625 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-93f26751-5ed2-4033-ab0d-64bcd3a75f20 req-04ff6c1f-af97-4a70-94d1-596ca411bb68 service nova] Creating event network-changed:34f5dafc-2456-45ca-8aa3-b0e00e47f747 for instance 92878816-6457-4392-b0bc-fb172b09fb2c on hv-cinder-84213 May 26 14:01:48.721740 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-93f26751-5ed2-4033-ab0d-64bcd3a75f20 req-04ff6c1f-af97-4a70-94d1-596ca411bb68 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164404 May 26 14:01:48.722336 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 387/733] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:01:48.970706 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4903442d-e894-4791-99d7-788ed453e2e4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:48.971830 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4903442d-e894-4791-99d7-788ed453e2e4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:48.978182 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4903442d-e894-4791-99d7-788ed453e2e4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:48.978632 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4903442d-e894-4791-99d7-788ed453e2e4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:48.979407 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4903442d-e894-4791-99d7-788ed453e2e4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:48.979846 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4903442d-e894-4791-99d7-788ed453e2e4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:49.115993 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4903442d-e894-4791-99d7-788ed453e2e4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:49.125261 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4903442d-e894-4791-99d7-788ed453e2e4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:49.126677 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4903442d-e894-4791-99d7-788ed453e2e4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:49.127841 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4903442d-e894-4791-99d7-788ed453e2e4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.161453 May 26 14:01:49.128406 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 347/734] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:48 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:49.472483 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-35ae789a-c7f3-4ff8-be28-d3fdebd440b1 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:49.473229 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-35ae789a-c7f3-4ff8-be28-d3fdebd440b1 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 92878816-6457-4392-b0bc-fb172b09fb2c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:49.480561 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-35ae789a-c7f3-4ff8-be28-d3fdebd440b1 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:49.481078 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-35ae789a-c7f3-4ff8-be28-d3fdebd440b1 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:49.482082 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-35ae789a-c7f3-4ff8-be28-d3fdebd440b1 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:49.482596 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-35ae789a-c7f3-4ff8-be28-d3fdebd440b1 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:49.631319 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-35ae789a-c7f3-4ff8-be28-d3fdebd440b1 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:49.641037 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-35ae789a-c7f3-4ff8-be28-d3fdebd440b1 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c" status: 200 len: 1319 microversion: 2.1 time: 0.174389 May 26 14:01:49.641799 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 388/735] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:01:49 2022] GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:49.882255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-a9167d5c-94ea-4bda-94eb-99b3364eb382 req-c5a649c7-8e5c-4328-b6f9-91c237fd2e7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9116ee60-50e6-48c5-bcc1-8e9d08e35458", "name": "network-vif-plugged", "status": "completed", "tag": "0d486a1e-7691-438f-a89c-df9425b682f1"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:01:49.885843 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=34 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:49.891818 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-a9167d5c-94ea-4bda-94eb-99b3364eb382 req-c5a649c7-8e5c-4328-b6f9-91c237fd2e7a service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:49.892267 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-a9167d5c-94ea-4bda-94eb-99b3364eb382 req-c5a649c7-8e5c-4328-b6f9-91c237fd2e7a service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:49.903205 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-a9167d5c-94ea-4bda-94eb-99b3364eb382 req-c5a649c7-8e5c-4328-b6f9-91c237fd2e7a service nova] Creating event network-vif-plugged:0d486a1e-7691-438f-a89c-df9425b682f1 for instance 9116ee60-50e6-48c5-bcc1-8e9d08e35458 on hv-cinder-84213 May 26 14:01:49.908213 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-a9167d5c-94ea-4bda-94eb-99b3364eb382 req-c5a649c7-8e5c-4328-b6f9-91c237fd2e7a service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090017 May 26 14:01:49.908792 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 348/736] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:01:50.146851 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ee3dbecd-87f5-45a4-9fb0-2884bdfb8648 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:50.147878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ee3dbecd-87f5-45a4-9fb0-2884bdfb8648 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:50.154102 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ee3dbecd-87f5-45a4-9fb0-2884bdfb8648 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:50.154544 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ee3dbecd-87f5-45a4-9fb0-2884bdfb8648 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:50.155297 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ee3dbecd-87f5-45a4-9fb0-2884bdfb8648 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:50.155727 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ee3dbecd-87f5-45a4-9fb0-2884bdfb8648 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:50.284263 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ee3dbecd-87f5-45a4-9fb0-2884bdfb8648 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:50.293339 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ee3dbecd-87f5-45a4-9fb0-2884bdfb8648 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:50.294844 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ee3dbecd-87f5-45a4-9fb0-2884bdfb8648 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:50.295987 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ee3dbecd-87f5-45a4-9fb0-2884bdfb8648 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.153388 May 26 14:01:50.296550 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 389/737] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:50 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:50.659334 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-92dc01a4-baf3-45a0-a647-5501109afb04 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:50.659982 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-92dc01a4-baf3-45a0-a647-5501109afb04 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 92878816-6457-4392-b0bc-fb172b09fb2c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:50.666361 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-92dc01a4-baf3-45a0-a647-5501109afb04 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:50.666814 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-92dc01a4-baf3-45a0-a647-5501109afb04 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:50.667582 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-92dc01a4-baf3-45a0-a647-5501109afb04 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:50.668056 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-92dc01a4-baf3-45a0-a647-5501109afb04 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:50.797802 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-92dc01a4-baf3-45a0-a647-5501109afb04 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:50.805726 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-92dc01a4-baf3-45a0-a647-5501109afb04 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c" status: 200 len: 1319 microversion: 2.1 time: 0.150729 May 26 14:01:50.806290 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 349/738] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:01:50 2022] GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:51.314118 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6fa9b772-6582-4cfc-bd80-79b407f7dc26 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:51.314722 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6fa9b772-6582-4cfc-bd80-79b407f7dc26 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:51.321453 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6fa9b772-6582-4cfc-bd80-79b407f7dc26 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:51.321902 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6fa9b772-6582-4cfc-bd80-79b407f7dc26 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:51.322934 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6fa9b772-6582-4cfc-bd80-79b407f7dc26 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:51.323373 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6fa9b772-6582-4cfc-bd80-79b407f7dc26 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:51.453170 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6fa9b772-6582-4cfc-bd80-79b407f7dc26 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:51.461634 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6fa9b772-6582-4cfc-bd80-79b407f7dc26 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:51.463173 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6fa9b772-6582-4cfc-bd80-79b407f7dc26 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:51.464322 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6fa9b772-6582-4cfc-bd80-79b407f7dc26 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.154117 May 26 14:01:51.464880 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 390/739] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:51 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:51.822521 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-853bb21c-c05f-4316-a356-41511973d593 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:51.823069 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-853bb21c-c05f-4316-a356-41511973d593 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 92878816-6457-4392-b0bc-fb172b09fb2c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:51.829514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-853bb21c-c05f-4316-a356-41511973d593 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:51.829963 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-853bb21c-c05f-4316-a356-41511973d593 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:51.830729 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-853bb21c-c05f-4316-a356-41511973d593 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:51.831167 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-853bb21c-c05f-4316-a356-41511973d593 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:51.964311 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-853bb21c-c05f-4316-a356-41511973d593 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:51.973851 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-853bb21c-c05f-4316-a356-41511973d593 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c" status: 200 len: 1319 microversion: 2.1 time: 0.155543 May 26 14:01:51.974437 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 350/740] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:01:51 2022] GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:52.482601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0ff2caae-9564-4261-82ed-b1a265904790 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:52.483194 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0ff2caae-9564-4261-82ed-b1a265904790 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:52.490828 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0ff2caae-9564-4261-82ed-b1a265904790 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:52.491294 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0ff2caae-9564-4261-82ed-b1a265904790 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:52.492349 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0ff2caae-9564-4261-82ed-b1a265904790 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:52.492562 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0ff2caae-9564-4261-82ed-b1a265904790 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:52.619714 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0ff2caae-9564-4261-82ed-b1a265904790 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:52.628084 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0ff2caae-9564-4261-82ed-b1a265904790 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:52.629602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0ff2caae-9564-4261-82ed-b1a265904790 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:52.630747 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0ff2caae-9564-4261-82ed-b1a265904790 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.152008 May 26 14:01:52.631302 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 391/741] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:52 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:52.991767 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-59e33640-0cf8-4f8d-871d-b8ce20fe3797 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:52.992545 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-59e33640-0cf8-4f8d-871d-b8ce20fe3797 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 92878816-6457-4392-b0bc-fb172b09fb2c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:52.999487 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-59e33640-0cf8-4f8d-871d-b8ce20fe3797 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:53.001059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-59e33640-0cf8-4f8d-871d-b8ce20fe3797 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:53.001059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-59e33640-0cf8-4f8d-871d-b8ce20fe3797 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:53.001641 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-59e33640-0cf8-4f8d-871d-b8ce20fe3797 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:53.140987 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-59e33640-0cf8-4f8d-871d-b8ce20fe3797 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:53.149308 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-59e33640-0cf8-4f8d-871d-b8ce20fe3797 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c" status: 200 len: 1319 microversion: 2.1 time: 0.161886 May 26 14:01:53.149908 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 351/742] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:01:52 2022] GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:53.649546 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c663a978-b3f8-49f7-b6a9-5001c5ae9108 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:53.650144 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c663a978-b3f8-49f7-b6a9-5001c5ae9108 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:53.656851 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c663a978-b3f8-49f7-b6a9-5001c5ae9108 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:53.657342 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c663a978-b3f8-49f7-b6a9-5001c5ae9108 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:53.658106 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c663a978-b3f8-49f7-b6a9-5001c5ae9108 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:53.658532 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c663a978-b3f8-49f7-b6a9-5001c5ae9108 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:53.780703 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-12a8bf17-2f11-4053-98a1-a1c56d298e6c req-66f2a468-9eb8-4901-a873-7c9209fd477b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92878816-6457-4392-b0bc-fb172b09fb2c", "name": "network-vif-plugged", "status": "completed", "tag": "34f5dafc-2456-45ca-8aa3-b0e00e47f747"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:01:53.793067 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-12a8bf17-2f11-4053-98a1-a1c56d298e6c req-66f2a468-9eb8-4901-a873-7c9209fd477b service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:53.793583 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-12a8bf17-2f11-4053-98a1-a1c56d298e6c req-66f2a468-9eb8-4901-a873-7c9209fd477b service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:53.803618 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c663a978-b3f8-49f7-b6a9-5001c5ae9108 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:53.808383 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-12a8bf17-2f11-4053-98a1-a1c56d298e6c req-66f2a468-9eb8-4901-a873-7c9209fd477b service nova] Creating event network-vif-plugged:34f5dafc-2456-45ca-8aa3-b0e00e47f747 for instance 92878816-6457-4392-b0bc-fb172b09fb2c on hv-cinder-84213 May 26 14:01:53.813733 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c663a978-b3f8-49f7-b6a9-5001c5ae9108 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:53.814099 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-12a8bf17-2f11-4053-98a1-a1c56d298e6c req-66f2a468-9eb8-4901-a873-7c9209fd477b service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037647 May 26 14:01:53.815494 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c663a978-b3f8-49f7-b6a9-5001c5ae9108 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:53.815765 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 352/743] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:01:53.817525 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c663a978-b3f8-49f7-b6a9-5001c5ae9108 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.172136 May 26 14:01:53.818154 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 392/744] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:53 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:54.167338 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-57352804-5813-4730-aadc-c44ad7a51b73 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:54.168027 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-57352804-5813-4730-aadc-c44ad7a51b73 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 92878816-6457-4392-b0bc-fb172b09fb2c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:54.174463 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57352804-5813-4730-aadc-c44ad7a51b73 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:54.174919 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57352804-5813-4730-aadc-c44ad7a51b73 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:54.175673 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57352804-5813-4730-aadc-c44ad7a51b73 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:54.176107 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57352804-5813-4730-aadc-c44ad7a51b73 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:54.302983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-57352804-5813-4730-aadc-c44ad7a51b73 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:54.310376 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-57352804-5813-4730-aadc-c44ad7a51b73 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c" status: 200 len: 1319 microversion: 2.1 time: 0.147808 May 26 14:01:54.310952 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 353/745] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:01:54 2022] GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:54.836507 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7f309768-bdb3-4c7b-af4c-85967fcbf18e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:54.837119 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7f309768-bdb3-4c7b-af4c-85967fcbf18e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:54.843561 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f309768-bdb3-4c7b-af4c-85967fcbf18e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:54.844012 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f309768-bdb3-4c7b-af4c-85967fcbf18e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:54.844789 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f309768-bdb3-4c7b-af4c-85967fcbf18e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:54.845250 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f309768-bdb3-4c7b-af4c-85967fcbf18e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:54.977143 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7f309768-bdb3-4c7b-af4c-85967fcbf18e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:54.985709 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7f309768-bdb3-4c7b-af4c-85967fcbf18e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:54.987215 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7f309768-bdb3-4c7b-af4c-85967fcbf18e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:54.988357 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7f309768-bdb3-4c7b-af4c-85967fcbf18e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.155859 May 26 14:01:54.988916 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 393/746] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:54 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:55.331015 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0ed65d06-4406-4457-86a3-4903c5393456 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:55.331712 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0ed65d06-4406-4457-86a3-4903c5393456 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 92878816-6457-4392-b0bc-fb172b09fb2c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:55.340295 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ed65d06-4406-4457-86a3-4903c5393456 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:55.340759 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ed65d06-4406-4457-86a3-4903c5393456 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:55.341925 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ed65d06-4406-4457-86a3-4903c5393456 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:55.342371 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ed65d06-4406-4457-86a3-4903c5393456 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:55.493020 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0ed65d06-4406-4457-86a3-4903c5393456 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:55.501054 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0ed65d06-4406-4457-86a3-4903c5393456 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c" status: 200 len: 1319 microversion: 2.1 time: 0.174061 May 26 14:01:55.502348 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 354/747] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:01:55 2022] GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:56.007846 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1c0dc78a-9ece-48be-ba12-890e549e80b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:56.008412 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1c0dc78a-9ece-48be-ba12-890e549e80b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:56.014976 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1c0dc78a-9ece-48be-ba12-890e549e80b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:56.015434 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1c0dc78a-9ece-48be-ba12-890e549e80b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:56.016218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1c0dc78a-9ece-48be-ba12-890e549e80b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:56.016654 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1c0dc78a-9ece-48be-ba12-890e549e80b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:56.031596 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:56.049731 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=6 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:56.165822 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1c0dc78a-9ece-48be-ba12-890e549e80b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:56.174351 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1c0dc78a-9ece-48be-ba12-890e549e80b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:56.175851 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1c0dc78a-9ece-48be-ba12-890e549e80b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:56.177008 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1c0dc78a-9ece-48be-ba12-890e549e80b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1809 microversion: 2.20 time: 0.173910 May 26 14:01:56.177597 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 394/748] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:56 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:56.518025 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-eb3150a0-5377-4107-b420-42c5bb8fb3af tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:56.518631 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-eb3150a0-5377-4107-b420-42c5bb8fb3af tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 92878816-6457-4392-b0bc-fb172b09fb2c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:56.520845 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:56.526752 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eb3150a0-5377-4107-b420-42c5bb8fb3af tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:56.527199 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eb3150a0-5377-4107-b420-42c5bb8fb3af tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:56.527960 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eb3150a0-5377-4107-b420-42c5bb8fb3af tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:56.528391 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eb3150a0-5377-4107-b420-42c5bb8fb3af tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:56.654632 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-eb3150a0-5377-4107-b420-42c5bb8fb3af tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:56.663018 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-eb3150a0-5377-4107-b420-42c5bb8fb3af tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c" status: 200 len: 1319 microversion: 2.1 time: 0.148349 May 26 14:01:56.663596 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 355/749] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:01:56 2022] GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:57.196261 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5e91867e-fdfd-4682-8a89-e478165303d4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:57.196867 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5e91867e-fdfd-4682-8a89-e478165303d4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:57.203168 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5e91867e-fdfd-4682-8a89-e478165303d4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:57.203721 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5e91867e-fdfd-4682-8a89-e478165303d4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:57.204411 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5e91867e-fdfd-4682-8a89-e478165303d4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:57.204846 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5e91867e-fdfd-4682-8a89-e478165303d4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:57.332732 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5e91867e-fdfd-4682-8a89-e478165303d4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:57.342023 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5e91867e-fdfd-4682-8a89-e478165303d4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:57.343528 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5e91867e-fdfd-4682-8a89-e478165303d4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:57.344678 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5e91867e-fdfd-4682-8a89-e478165303d4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1796 microversion: 2.20 time: 0.153012 May 26 14:01:57.345292 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 395/750] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:01:57 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1796 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:01:57.680401 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fe3b402a-337c-4e46-8206-564aac4ea402 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:57.681014 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-fe3b402a-337c-4e46-8206-564aac4ea402 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 92878816-6457-4392-b0bc-fb172b09fb2c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:57.687494 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fe3b402a-337c-4e46-8206-564aac4ea402 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:57.687934 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fe3b402a-337c-4e46-8206-564aac4ea402 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:57.688694 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fe3b402a-337c-4e46-8206-564aac4ea402 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:57.689130 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fe3b402a-337c-4e46-8206-564aac4ea402 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:57.816983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-fe3b402a-337c-4e46-8206-564aac4ea402 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:57.824750 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-fe3b402a-337c-4e46-8206-564aac4ea402 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c" status: 200 len: 1319 microversion: 2.1 time: 0.148681 May 26 14:01:57.825541 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 356/751] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:01:57 2022] GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:58.842449 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a32dab29-358a-417e-aba9-3bf9e6bd77ff tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:58.843085 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a32dab29-358a-417e-aba9-3bf9e6bd77ff tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 92878816-6457-4392-b0bc-fb172b09fb2c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:58.849974 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a32dab29-358a-417e-aba9-3bf9e6bd77ff tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:58.850420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a32dab29-358a-417e-aba9-3bf9e6bd77ff tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:58.851190 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a32dab29-358a-417e-aba9-3bf9e6bd77ff tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:58.851633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a32dab29-358a-417e-aba9-3bf9e6bd77ff tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:58.985608 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a32dab29-358a-417e-aba9-3bf9e6bd77ff tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:58.987781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:59.002393 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a32dab29-358a-417e-aba9-3bf9e6bd77ff tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c" status: 200 len: 1319 microversion: 2.1 time: 0.163793 May 26 14:01:59.002969 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 396/752] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:01:58 2022] GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:02:00.021265 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5d2879b3-d44e-41cb-8428-533ca67a0fb5 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:00.022366 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5d2879b3-d44e-41cb-8428-533ca67a0fb5 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 92878816-6457-4392-b0bc-fb172b09fb2c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:00.028947 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5d2879b3-d44e-41cb-8428-533ca67a0fb5 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:00.029400 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5d2879b3-d44e-41cb-8428-533ca67a0fb5 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:00.030173 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5d2879b3-d44e-41cb-8428-533ca67a0fb5 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:00.030610 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5d2879b3-d44e-41cb-8428-533ca67a0fb5 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:00.165513 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5d2879b3-d44e-41cb-8428-533ca67a0fb5 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:00.172889 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5d2879b3-d44e-41cb-8428-533ca67a0fb5 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c" status: 200 len: 1507 microversion: 2.1 time: 0.155879 May 26 14:02:00.173493 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 357/753] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:00 2022] GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:18.861237 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:02:18.969213 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2afe4b0f-a58b-4ea4-95a0-71e4519eca34 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48cefb20-0ef9-47ec-8225-5d5a822f9b62"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:02:18.970350 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2afe4b0f-a58b-4ea4-95a0-71e4519eca34 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:18.977092 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2afe4b0f-a58b-4ea4-95a0-71e4519eca34 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:18.977580 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2afe4b0f-a58b-4ea4-95a0-71e4519eca34 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:18.978353 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2afe4b0f-a58b-4ea4-95a0-71e4519eca34 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:18.978790 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2afe4b0f-a58b-4ea4-95a0-71e4519eca34 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:19.262256 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2afe4b0f-a58b-4ea4-95a0-71e4519eca34 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "POST /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.406372 May 26 14:02:19.263038 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 397/754] 10.222.0.91 () {60 vars in 1322 bytes} [Thu May 26 14:02:18 2022] POST /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471/os-volume_attachments => generated 194 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:02:27.824101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a4dc8c8c-80bb-4d1a-8bc1-5d06e0df0219 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:02:27.825074 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a4dc8c8c-80bb-4d1a-8bc1-5d06e0df0219 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:27.827177 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=19 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:02:27.827813 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=83 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:02:27.833451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a4dc8c8c-80bb-4d1a-8bc1-5d06e0df0219 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:27.833904 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a4dc8c8c-80bb-4d1a-8bc1-5d06e0df0219 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:27.834669 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a4dc8c8c-80bb-4d1a-8bc1-5d06e0df0219 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:27.835108 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a4dc8c8c-80bb-4d1a-8bc1-5d06e0df0219 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:27.858033 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-a4dc8c8c-80bb-4d1a-8bc1-5d06e0df0219 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lazy-loading 'flavor' on Instance uuid aa89e8ed-11d3-42d2-b030-5b7497694471 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:02:27.929597 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1d0129d2-6625-4884-8bc0-5d71fd752dc0 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d064fc4-bc63-427e-865b-2780f87f4b13", "device": "/dev/sdb"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:02:27.931407 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1d0129d2-6625-4884-8bc0-5d71fd752dc0 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 92878816-6457-4392-b0bc-fb172b09fb2c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:27.937609 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1d0129d2-6625-4884-8bc0-5d71fd752dc0 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:27.938049 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1d0129d2-6625-4884-8bc0-5d71fd752dc0 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:27.938816 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1d0129d2-6625-4884-8bc0-5d71fd752dc0 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:27.939239 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1d0129d2-6625-4884-8bc0-5d71fd752dc0 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:28.022572 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a4dc8c8c-80bb-4d1a-8bc1-5d06e0df0219 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "POST /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471/action" status: 200 len: 32 microversion: 2.1 time: 0.202649 May 26 14:02:28.023192 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 358/755] 10.222.0.91 () {60 vars in 1277 bytes} [Thu May 26 14:02:27 2022] POST /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471/action => generated 32 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 14:02:28.032798 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-734a5952-e1a4-44c8-9849-6ea547890c24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:28.033517 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-734a5952-e1a4-44c8-9849-6ea547890c24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:28.041601 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-734a5952-e1a4-44c8-9849-6ea547890c24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:28.042116 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-734a5952-e1a4-44c8-9849-6ea547890c24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:28.042826 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-734a5952-e1a4-44c8-9849-6ea547890c24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:28.043278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-734a5952-e1a4-44c8-9849-6ea547890c24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:28.190019 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-734a5952-e1a4-44c8-9849-6ea547890c24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:28.201742 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-734a5952-e1a4-44c8-9849-6ea547890c24 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1735 microversion: 2.1 time: 0.172589 May 26 14:02:28.202814 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 359/756] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:28 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:02:28.263933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1d0129d2-6625-4884-8bc0-5d71fd752dc0 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "POST /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.339016 May 26 14:02:28.264697 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 398/757] 10.222.0.91 () {60 vars in 1322 bytes} [Thu May 26 14:02:27 2022] POST /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:02:29.219216 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6eab00db-4cc9-4b00-b465-b88844e03702 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:29.219879 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6eab00db-4cc9-4b00-b465-b88844e03702 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:29.226348 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6eab00db-4cc9-4b00-b465-b88844e03702 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:29.226794 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6eab00db-4cc9-4b00-b465-b88844e03702 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:29.227542 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6eab00db-4cc9-4b00-b465-b88844e03702 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:29.228586 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6eab00db-4cc9-4b00-b465-b88844e03702 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:29.358530 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6eab00db-4cc9-4b00-b465-b88844e03702 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:29.366432 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6eab00db-4cc9-4b00-b465-b88844e03702 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1735 microversion: 2.1 time: 0.151071 May 26 14:02:29.367008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 360/758] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:29 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:30.385230 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3c6f8ba0-b106-4816-95d6-ee92153e9b89 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:30.385934 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3c6f8ba0-b106-4816-95d6-ee92153e9b89 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:30.392508 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c6f8ba0-b106-4816-95d6-ee92153e9b89 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:30.392968 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c6f8ba0-b106-4816-95d6-ee92153e9b89 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:30.393771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c6f8ba0-b106-4816-95d6-ee92153e9b89 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:30.394211 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c6f8ba0-b106-4816-95d6-ee92153e9b89 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:30.524848 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3c6f8ba0-b106-4816-95d6-ee92153e9b89 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:30.532785 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3c6f8ba0-b106-4816-95d6-ee92153e9b89 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1735 microversion: 2.1 time: 0.152924 May 26 14:02:30.533361 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 399/759] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:30 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:31.548957 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d2618ddc-fe97-4543-a02d-cc8218f3c133 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:31.549599 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d2618ddc-fe97-4543-a02d-cc8218f3c133 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:31.556852 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d2618ddc-fe97-4543-a02d-cc8218f3c133 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:31.557351 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d2618ddc-fe97-4543-a02d-cc8218f3c133 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:31.558124 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d2618ddc-fe97-4543-a02d-cc8218f3c133 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:31.558594 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d2618ddc-fe97-4543-a02d-cc8218f3c133 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:31.684429 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d2618ddc-fe97-4543-a02d-cc8218f3c133 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:31.692495 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d2618ddc-fe97-4543-a02d-cc8218f3c133 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1735 microversion: 2.1 time: 0.147285 May 26 14:02:31.693064 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 361/760] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:31 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:32.709895 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7b83cf69-ddd8-4eed-bbfa-cb9f6d0bd5d2 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:32.710504 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7b83cf69-ddd8-4eed-bbfa-cb9f6d0bd5d2 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:32.717123 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7b83cf69-ddd8-4eed-bbfa-cb9f6d0bd5d2 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:32.717600 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7b83cf69-ddd8-4eed-bbfa-cb9f6d0bd5d2 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:32.718366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7b83cf69-ddd8-4eed-bbfa-cb9f6d0bd5d2 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:32.718804 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7b83cf69-ddd8-4eed-bbfa-cb9f6d0bd5d2 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:32.848761 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7b83cf69-ddd8-4eed-bbfa-cb9f6d0bd5d2 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:32.856682 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7b83cf69-ddd8-4eed-bbfa-cb9f6d0bd5d2 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1735 microversion: 2.1 time: 0.150663 May 26 14:02:32.857264 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 400/761] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:32 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:33.873429 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-43856740-bbf5-4692-8343-4e9dd04a685e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:33.873984 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-43856740-bbf5-4692-8343-4e9dd04a685e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:33.880266 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43856740-bbf5-4692-8343-4e9dd04a685e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:33.880716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43856740-bbf5-4692-8343-4e9dd04a685e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:33.881502 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43856740-bbf5-4692-8343-4e9dd04a685e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:33.882042 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43856740-bbf5-4692-8343-4e9dd04a685e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:34.009766 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-43856740-bbf5-4692-8343-4e9dd04a685e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:34.018661 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-43856740-bbf5-4692-8343-4e9dd04a685e tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1735 microversion: 2.1 time: 0.149176 May 26 14:02:34.019231 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 362/762] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:33 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:35.037303 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-897738f8-6750-4cc6-9307-617ca9d07bf9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:35.037910 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-897738f8-6750-4cc6-9307-617ca9d07bf9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:35.044263 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-897738f8-6750-4cc6-9307-617ca9d07bf9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:35.044717 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-897738f8-6750-4cc6-9307-617ca9d07bf9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:35.045510 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-897738f8-6750-4cc6-9307-617ca9d07bf9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:35.045942 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-897738f8-6750-4cc6-9307-617ca9d07bf9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:35.173894 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-897738f8-6750-4cc6-9307-617ca9d07bf9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:35.182463 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-897738f8-6750-4cc6-9307-617ca9d07bf9 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1735 microversion: 2.1 time: 0.149006 May 26 14:02:35.183038 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 401/763] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:35 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:36.199872 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-04aa1ab5-dff2-45f9-9a06-603fec59eae1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:36.200491 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-04aa1ab5-dff2-45f9-9a06-603fec59eae1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:36.207020 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-04aa1ab5-dff2-45f9-9a06-603fec59eae1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:36.207472 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-04aa1ab5-dff2-45f9-9a06-603fec59eae1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:36.208234 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-04aa1ab5-dff2-45f9-9a06-603fec59eae1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:36.208676 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-04aa1ab5-dff2-45f9-9a06-603fec59eae1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:36.339637 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-04aa1ab5-dff2-45f9-9a06-603fec59eae1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:36.347390 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-04aa1ab5-dff2-45f9-9a06-603fec59eae1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1735 microversion: 2.1 time: 0.151500 May 26 14:02:36.347952 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 363/764] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:36 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:37.364306 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4b274fa0-64bb-4d41-b5a6-4aee1a9b18bc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:37.364916 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4b274fa0-64bb-4d41-b5a6-4aee1a9b18bc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:37.371426 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4b274fa0-64bb-4d41-b5a6-4aee1a9b18bc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:37.371871 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4b274fa0-64bb-4d41-b5a6-4aee1a9b18bc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:37.373044 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4b274fa0-64bb-4d41-b5a6-4aee1a9b18bc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:37.373193 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4b274fa0-64bb-4d41-b5a6-4aee1a9b18bc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:37.500003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4b274fa0-64bb-4d41-b5a6-4aee1a9b18bc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:37.507855 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4b274fa0-64bb-4d41-b5a6-4aee1a9b18bc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1735 microversion: 2.1 time: 0.147404 May 26 14:02:37.508414 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 402/765] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:37 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:38.525070 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-43716a16-3a07-4559-abd6-46b11e2ad9e8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:38.525706 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-43716a16-3a07-4559-abd6-46b11e2ad9e8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:38.532280 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43716a16-3a07-4559-abd6-46b11e2ad9e8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:38.532727 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43716a16-3a07-4559-abd6-46b11e2ad9e8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:38.533526 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43716a16-3a07-4559-abd6-46b11e2ad9e8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:38.533964 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43716a16-3a07-4559-abd6-46b11e2ad9e8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:38.901820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-43716a16-3a07-4559-abd6-46b11e2ad9e8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:38.909752 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-43716a16-3a07-4559-abd6-46b11e2ad9e8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1735 microversion: 2.1 time: 0.388505 May 26 14:02:38.910324 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 364/766] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:38 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1735 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:39.927544 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ad59fca3-e87e-4013-95c9-1ce9bee18c15 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:39.928153 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ad59fca3-e87e-4013-95c9-1ce9bee18c15 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:39.935429 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ad59fca3-e87e-4013-95c9-1ce9bee18c15 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:39.935882 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ad59fca3-e87e-4013-95c9-1ce9bee18c15 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:39.936662 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ad59fca3-e87e-4013-95c9-1ce9bee18c15 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:39.937106 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ad59fca3-e87e-4013-95c9-1ce9bee18c15 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:40.070327 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ad59fca3-e87e-4013-95c9-1ce9bee18c15 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:40.078169 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ad59fca3-e87e-4013-95c9-1ce9bee18c15 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1735 microversion: 2.1 time: 0.154563 May 26 14:02:40.078735 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 403/767] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:39 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:41.094888 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-09a8bdab-10da-4d85-8caf-6d231a5de924 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:41.095504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-09a8bdab-10da-4d85-8caf-6d231a5de924 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:41.102398 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09a8bdab-10da-4d85-8caf-6d231a5de924 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:41.102849 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09a8bdab-10da-4d85-8caf-6d231a5de924 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:41.103648 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09a8bdab-10da-4d85-8caf-6d231a5de924 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:41.104086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09a8bdab-10da-4d85-8caf-6d231a5de924 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:41.232652 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-09a8bdab-10da-4d85-8caf-6d231a5de924 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:41.240461 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-09a8bdab-10da-4d85-8caf-6d231a5de924 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1735 microversion: 2.1 time: 0.149364 May 26 14:02:41.241058 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 365/768] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:41 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:42.260457 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e30c7ec4-15fc-4bee-ba03-5a689b725d5a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:42.261062 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e30c7ec4-15fc-4bee-ba03-5a689b725d5a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:42.268000 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e30c7ec4-15fc-4bee-ba03-5a689b725d5a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:42.268379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e30c7ec4-15fc-4bee-ba03-5a689b725d5a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:42.269179 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e30c7ec4-15fc-4bee-ba03-5a689b725d5a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:42.269863 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e30c7ec4-15fc-4bee-ba03-5a689b725d5a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:42.413451 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e30c7ec4-15fc-4bee-ba03-5a689b725d5a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:42.421342 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e30c7ec4-15fc-4bee-ba03-5a689b725d5a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1735 microversion: 2.1 time: 0.165112 May 26 14:02:42.421906 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 404/769] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:42 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:43.438382 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5c7969a5-df38-4fcc-9bcd-bcc766d8b45a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:43.438993 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5c7969a5-df38-4fcc-9bcd-bcc766d8b45a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:43.445504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5c7969a5-df38-4fcc-9bcd-bcc766d8b45a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:43.445899 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5c7969a5-df38-4fcc-9bcd-bcc766d8b45a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:43.446669 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5c7969a5-df38-4fcc-9bcd-bcc766d8b45a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:43.447107 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5c7969a5-df38-4fcc-9bcd-bcc766d8b45a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:43.574432 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5c7969a5-df38-4fcc-9bcd-bcc766d8b45a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:43.582316 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5c7969a5-df38-4fcc-9bcd-bcc766d8b45a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1735 microversion: 2.1 time: 0.147841 May 26 14:02:43.582895 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 366/770] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:43 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:44.599907 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c7c07924-333d-436f-9cfc-daa8121d06c4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:44.600601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c7c07924-333d-436f-9cfc-daa8121d06c4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:44.607699 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c7c07924-333d-436f-9cfc-daa8121d06c4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:44.608153 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c7c07924-333d-436f-9cfc-daa8121d06c4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:44.608930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c7c07924-333d-436f-9cfc-daa8121d06c4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:44.609396 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c7c07924-333d-436f-9cfc-daa8121d06c4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:44.738644 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c7c07924-333d-436f-9cfc-daa8121d06c4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:44.746717 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c7c07924-333d-436f-9cfc-daa8121d06c4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1735 microversion: 2.1 time: 0.150808 May 26 14:02:44.747344 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 405/771] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:44 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:45.764301 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-da1ea072-6530-4809-a670-0564fa36d2fd tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:45.765473 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-da1ea072-6530-4809-a670-0564fa36d2fd tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:45.771525 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da1ea072-6530-4809-a670-0564fa36d2fd tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:45.771982 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da1ea072-6530-4809-a670-0564fa36d2fd tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:45.772763 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da1ea072-6530-4809-a670-0564fa36d2fd tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:45.773221 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da1ea072-6530-4809-a670-0564fa36d2fd tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:45.904242 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-da1ea072-6530-4809-a670-0564fa36d2fd tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:45.912192 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-da1ea072-6530-4809-a670-0564fa36d2fd tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1735 microversion: 2.1 time: 0.152104 May 26 14:02:45.912765 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 367/772] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:45 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:46.929686 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-45030710-d0df-4c56-a74b-8e32fb4a0713 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:46.930323 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-45030710-d0df-4c56-a74b-8e32fb4a0713 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:46.937318 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-45030710-d0df-4c56-a74b-8e32fb4a0713 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:46.937771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-45030710-d0df-4c56-a74b-8e32fb4a0713 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:46.938533 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-45030710-d0df-4c56-a74b-8e32fb4a0713 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:46.938973 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-45030710-d0df-4c56-a74b-8e32fb4a0713 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:47.063698 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-45030710-d0df-4c56-a74b-8e32fb4a0713 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:47.074295 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-45030710-d0df-4c56-a74b-8e32fb4a0713 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1735 microversion: 2.1 time: 0.148427 May 26 14:02:47.074865 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 406/773] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:46 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:48.092587 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-aec9e7dd-0f4f-4af5-acc6-3f52055cdffa tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:48.093256 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-aec9e7dd-0f4f-4af5-acc6-3f52055cdffa tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:48.099826 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aec9e7dd-0f4f-4af5-acc6-3f52055cdffa tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:48.100279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aec9e7dd-0f4f-4af5-acc6-3f52055cdffa tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:48.101050 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aec9e7dd-0f4f-4af5-acc6-3f52055cdffa tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:48.101517 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aec9e7dd-0f4f-4af5-acc6-3f52055cdffa tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:48.231096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-aec9e7dd-0f4f-4af5-acc6-3f52055cdffa tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:48.238998 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-aec9e7dd-0f4f-4af5-acc6-3f52055cdffa tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1735 microversion: 2.1 time: 0.151436 May 26 14:02:48.239566 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 368/774] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:48 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:49.256001 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-610cd9e0-b5d1-408c-83c2-0d78a85b2310 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:49.256604 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-610cd9e0-b5d1-408c-83c2-0d78a85b2310 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:49.259361 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=21 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:02:49.265362 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-610cd9e0-b5d1-408c-83c2-0d78a85b2310 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:49.265817 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-610cd9e0-b5d1-408c-83c2-0d78a85b2310 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:49.266588 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-610cd9e0-b5d1-408c-83c2-0d78a85b2310 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:49.267026 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-610cd9e0-b5d1-408c-83c2-0d78a85b2310 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:49.270290 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:02:49.400986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-610cd9e0-b5d1-408c-83c2-0d78a85b2310 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:49.409400 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-610cd9e0-b5d1-408c-83c2-0d78a85b2310 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1735 microversion: 2.1 time: 0.157226 May 26 14:02:49.409965 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 407/775] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:49 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:50.426880 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d787d747-1505-4360-bb23-94cdc779326a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:50.427491 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d787d747-1505-4360-bb23-94cdc779326a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:50.434039 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d787d747-1505-4360-bb23-94cdc779326a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:50.434495 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d787d747-1505-4360-bb23-94cdc779326a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:50.435270 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d787d747-1505-4360-bb23-94cdc779326a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:50.435707 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d787d747-1505-4360-bb23-94cdc779326a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:50.720250 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d787d747-1505-4360-bb23-94cdc779326a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:50.728390 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d787d747-1505-4360-bb23-94cdc779326a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1735 microversion: 2.1 time: 0.305278 May 26 14:02:50.728901 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 369/776] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:50 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1735 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:51.747805 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b9be22cb-ac0c-47f0-85ae-76b5a6ba3263 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:51.748406 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b9be22cb-ac0c-47f0-85ae-76b5a6ba3263 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:51.755992 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b9be22cb-ac0c-47f0-85ae-76b5a6ba3263 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:51.756446 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b9be22cb-ac0c-47f0-85ae-76b5a6ba3263 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:51.757244 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b9be22cb-ac0c-47f0-85ae-76b5a6ba3263 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:51.757683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b9be22cb-ac0c-47f0-85ae-76b5a6ba3263 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:51.889249 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b9be22cb-ac0c-47f0-85ae-76b5a6ba3263 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:51.897509 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b9be22cb-ac0c-47f0-85ae-76b5a6ba3263 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1735 microversion: 2.1 time: 0.155325 May 26 14:02:51.898090 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 408/777] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:51 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:52.174653 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:02:52.175248 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Thu May 26 14:02:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 14:02:52.914562 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-986208f0-6d4b-433f-beaf-e9c471adeed4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:52.915172 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-986208f0-6d4b-433f-beaf-e9c471adeed4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:52.922223 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-986208f0-6d4b-433f-beaf-e9c471adeed4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:52.922675 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-986208f0-6d4b-433f-beaf-e9c471adeed4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:52.923437 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-986208f0-6d4b-433f-beaf-e9c471adeed4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:52.923875 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-986208f0-6d4b-433f-beaf-e9c471adeed4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:53.052553 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-986208f0-6d4b-433f-beaf-e9c471adeed4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:53.061029 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-986208f0-6d4b-433f-beaf-e9c471adeed4 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1735 microversion: 2.1 time: 0.150288 May 26 14:02:53.061705 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 370/778] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:52 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:54.079848 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-842a1315-a1c3-4166-a8c0-3c155888ee3f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:54.080435 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-842a1315-a1c3-4166-a8c0-3c155888ee3f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:54.086997 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-842a1315-a1c3-4166-a8c0-3c155888ee3f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:54.087468 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-842a1315-a1c3-4166-a8c0-3c155888ee3f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:54.088237 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-842a1315-a1c3-4166-a8c0-3c155888ee3f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:54.088676 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-842a1315-a1c3-4166-a8c0-3c155888ee3f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:54.219223 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-842a1315-a1c3-4166-a8c0-3c155888ee3f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:54.227309 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-842a1315-a1c3-4166-a8c0-3c155888ee3f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1735 microversion: 2.1 time: 0.151396 May 26 14:02:54.227879 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 409/779] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:54 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:55.243856 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0f19cc2f-26af-4be4-9e31-e0ea58b920c1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:55.244461 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0f19cc2f-26af-4be4-9e31-e0ea58b920c1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:55.251291 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f19cc2f-26af-4be4-9e31-e0ea58b920c1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:55.251831 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f19cc2f-26af-4be4-9e31-e0ea58b920c1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:55.252787 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f19cc2f-26af-4be4-9e31-e0ea58b920c1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:55.253275 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f19cc2f-26af-4be4-9e31-e0ea58b920c1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:55.385285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0f19cc2f-26af-4be4-9e31-e0ea58b920c1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:55.393625 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0f19cc2f-26af-4be4-9e31-e0ea58b920c1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1735 microversion: 2.1 time: 0.153682 May 26 14:02:55.394464 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 371/780] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:55 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:56.034562 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-586c9baf-b235-4f80-bea5-bede62a009dc tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:56.035118 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-586c9baf-b235-4f80-bea5-bede62a009dc tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 92878816-6457-4392-b0bc-fb172b09fb2c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:56.042934 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-586c9baf-b235-4f80-bea5-bede62a009dc tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:56.043436 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-586c9baf-b235-4f80-bea5-bede62a009dc tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:56.044307 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-586c9baf-b235-4f80-bea5-bede62a009dc tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:56.044741 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-586c9baf-b235-4f80-bea5-bede62a009dc tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:56.171138 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-586c9baf-b235-4f80-bea5-bede62a009dc tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lazy-loading 'services' on Instance uuid 92878816-6457-4392-b0bc-fb172b09fb2c {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:02:56.288469 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-586c9baf-b235-4f80-bea5-bede62a009dc tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "DELETE /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c/os-volume_attachments/0d064fc4-bc63-427e-865b-2780f87f4b13" status: 202 len: 0 microversion: 2.1 time: 0.257763 May 26 14:02:56.289059 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 410/781] 10.222.0.91 () {58 vars in 1415 bytes} [Thu May 26 14:02:56 2022] DELETE /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c/os-volume_attachments/0d064fc4-bc63-427e-865b-2780f87f4b13 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:02:56.411267 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f860a6e9-a7cb-4c41-a054-9753b5014490 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:56.412067 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f860a6e9-a7cb-4c41-a054-9753b5014490 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:56.418477 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f860a6e9-a7cb-4c41-a054-9753b5014490 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:56.418937 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f860a6e9-a7cb-4c41-a054-9753b5014490 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:56.419711 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f860a6e9-a7cb-4c41-a054-9753b5014490 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:56.420168 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f860a6e9-a7cb-4c41-a054-9753b5014490 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:56.438337 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:02:56.547817 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f860a6e9-a7cb-4c41-a054-9753b5014490 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:56.555725 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f860a6e9-a7cb-4c41-a054-9753b5014490 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1735 microversion: 2.1 time: 0.148248 May 26 14:02:56.556289 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 372/782] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:56 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:57.573754 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0f9f6374-be00-4bea-adc8-0997d2d07fcd tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:57.574366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0f9f6374-be00-4bea-adc8-0997d2d07fcd tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:57.581482 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0f9f6374-be00-4bea-adc8-0997d2d07fcd tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:57.581934 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0f9f6374-be00-4bea-adc8-0997d2d07fcd tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:57.582697 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0f9f6374-be00-4bea-adc8-0997d2d07fcd tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:57.583158 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0f9f6374-be00-4bea-adc8-0997d2d07fcd tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:57.721460 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0f9f6374-be00-4bea-adc8-0997d2d07fcd tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:57.735420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0f9f6374-be00-4bea-adc8-0997d2d07fcd tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1715 microversion: 2.1 time: 0.166069 May 26 14:02:57.736025 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 411/783] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:57 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1715 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:57.800477 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2eafc60f-d924-4138-a35b-d22be002e1e5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:57.801034 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2eafc60f-d924-4138-a35b-d22be002e1e5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:57.807435 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2eafc60f-d924-4138-a35b-d22be002e1e5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:57.807881 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2eafc60f-d924-4138-a35b-d22be002e1e5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:57.808634 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2eafc60f-d924-4138-a35b-d22be002e1e5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:57.809064 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2eafc60f-d924-4138-a35b-d22be002e1e5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:57.937501 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-2eafc60f-d924-4138-a35b-d22be002e1e5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] HTTP exception thrown: Cannot 'detach_volume' instance aa89e8ed-11d3-42d2-b030-5b7497694471 while it is in vm_state rescued May 26 14:02:57.939207 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2eafc60f-d924-4138-a35b-d22be002e1e5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Request method failure captured: May 26 14:02:57.939207 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: DELETE /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471/os-volume_attachments/48cefb20-0ef9-47ec-8225-5d5a822f9b62 HTTP/1.1 May 26 14:02:57.939207 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 14:02:57.939207 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 14:02:57.939207 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 14:02:57.939207 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 14:02:57.939207 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 14:02:57.939207 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 14:02:57.939207 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 14:02:57.939207 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 14:02:57.939207 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4b-Oa-X6jHN9Gz0z18y08tbmRNqhQxYbg6e0BLZYdSYeIsEe3D2y9tpoIKpFY4nKChjusqnkMX7zTWBNnntrwanhfW05syDJiYjjEY8aLgU67Tthga-5NQqGGlNnebZErUKMhE2yG3kiGK5Z82LAT1fimq3qIuG9eMK6nluEM7g7pc May 26 14:02:57.939207 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 14:02:57.939207 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 14:02:57.939207 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 14:02:57.939207 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 14:02:57.939207 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 14:02:57.939207 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 14:02:57.939207 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: e3d27b9eb0ef4c338c18c2a1d02db444 May 26 14:02:57.939207 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1535794059 May 26 14:02:57.939207 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 14:02:57.939207 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 14:02:57.940878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/e3d27b9eb0ef4c338c18c2a1d02db444"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/e3d27b9eb0ef4c338c18c2a1d02db444"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/e3d27b9eb0ef4c338c18c2a1d02db444"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_e3d27b9eb0ef4c338c18c2a1d02db444", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:02:57.940878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1535794059 May 26 14:02:57.940878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: e3d27b9eb0ef4c338c18c2a1d02db444 May 26 14:02:57.940878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1535794059 May 26 14:02:57.940878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-ServerRescueNegativeTestJSON-1535794059-project May 26 14:02:57.940878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 14:02:57.940878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 14:02:57.940878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: 8d7bcc48c8d844e5b36b1c4e2748e766 May 26 14:02:57.940878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1535794059-project May 26 14:02:57.940878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: > May 26 14:02:57.940878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Cannot 'detach_volume' instance aa89e8ed-11d3-42d2-b030-5b7497694471 while it is in vm_state rescued May 26 14:02:57.941726 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'server_id': 'aa89e8ed-11d3-42d2-b030-5b7497694471', 'id': '48cefb20-0ef9-47ec-8225-5d5a822f9b62'} May 26 14:02:57.941726 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:02:57.941726 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:02:57.941726 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 14:02:57.941726 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 14:02:57.941726 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 14:02:57.941726 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 14:02:57.941726 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 14:02:57.941726 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 14:02:57.941726 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aa89e8ed-11d3-42d2-b030-5b7497694471 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 26 14:02:57.941726 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:02:57.941726 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:02:57.941726 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:02:57.941726 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:02:57.941726 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:02:57.941726 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:02:57.941726 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:02:57.941726 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:02:57.941726 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:02:57.941726 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:02:57.942991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 26 14:02:57.942991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 14:02:57.942991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 14:02:57.942991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 14:02:57.942991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance aa89e8ed-11d3-42d2-b030-5b7497694471 while it is in vm_state rescued May 26 14:02:57.942991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:02:57.942991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:02:57.942991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:02:57.942991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:02:57.942991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:02:57.942991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:02:57.942991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:02:57.942991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:02:57.942991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance aa89e8ed-11d3-42d2-b030-5b7497694471 while it is in vm_state rescued May 26 14:02:57.942991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:02:57.942991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2eafc60f-d924-4138-a35b-d22be002e1e5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Returning 409 to user: Cannot 'detach_volume' instance aa89e8ed-11d3-42d2-b030-5b7497694471 while it is in vm_state rescued {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:02:57.944183 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2eafc60f-d924-4138-a35b-d22be002e1e5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "DELETE /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471/os-volume_attachments/48cefb20-0ef9-47ec-8225-5d5a822f9b62" status: 409 len: 152 microversion: 2.1 time: 0.144930 May 26 14:02:57.944183 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 373/784] 10.222.0.91 () {58 vars in 1415 bytes} [Thu May 26 14:02:57 2022] DELETE /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471/os-volume_attachments/48cefb20-0ef9-47ec-8225-5d5a822f9b62 => generated 152 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 14:02:57.949655 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b5dff01d-3baa-4f8a-bf29-db6e22e48489 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:02:57.950225 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b5dff01d-3baa-4f8a-bf29-db6e22e48489 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:57.956290 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b5dff01d-3baa-4f8a-bf29-db6e22e48489 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:57.956730 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b5dff01d-3baa-4f8a-bf29-db6e22e48489 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:57.957507 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b5dff01d-3baa-4f8a-bf29-db6e22e48489 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:57.957935 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b5dff01d-3baa-4f8a-bf29-db6e22e48489 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:58.021498 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b5dff01d-3baa-4f8a-bf29-db6e22e48489 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "POST /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471/action" status: 202 len: 0 microversion: 2.1 time: 0.075428 May 26 14:02:58.022859 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 412/785] 10.222.0.91 () {60 vars in 1277 bytes} [Thu May 26 14:02:57 2022] POST /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:02:58.031258 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9e916de3-40c4-4c79-aa37-8f5e277cdd6b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:58.031868 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9e916de3-40c4-4c79-aa37-8f5e277cdd6b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:58.034492 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=33 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:02:58.040067 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9e916de3-40c4-4c79-aa37-8f5e277cdd6b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:58.040523 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9e916de3-40c4-4c79-aa37-8f5e277cdd6b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:58.041342 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9e916de3-40c4-4c79-aa37-8f5e277cdd6b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:58.041795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9e916de3-40c4-4c79-aa37-8f5e277cdd6b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:58.176216 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9e916de3-40c4-4c79-aa37-8f5e277cdd6b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:58.185024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9e916de3-40c4-4c79-aa37-8f5e277cdd6b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1723 microversion: 2.1 time: 0.158039 May 26 14:02:58.185716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 374/786] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:58 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:58.462873 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-384f8afd-1b2c-4067-80e6-d64182e30f93 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:58.463452 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-384f8afd-1b2c-4067-80e6-d64182e30f93 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 92878816-6457-4392-b0bc-fb172b09fb2c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:58.469506 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-384f8afd-1b2c-4067-80e6-d64182e30f93 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:58.469947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-384f8afd-1b2c-4067-80e6-d64182e30f93 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:58.470709 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-384f8afd-1b2c-4067-80e6-d64182e30f93 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:58.471140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-384f8afd-1b2c-4067-80e6-d64182e30f93 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:58.496639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-384f8afd-1b2c-4067-80e6-d64182e30f93 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 92878816-6457-4392-b0bc-fb172b09fb2c] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 14:02:58.579464 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-384f8afd-1b2c-4067-80e6-d64182e30f93 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "DELETE /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c" status: 204 len: 0 microversion: 2.1 time: 0.120490 May 26 14:02:58.583148 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 413/787] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 14:02:58 2022] DELETE /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 14:02:58.588285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-83019feb-a5c4-4f5b-9c4a-32033dab6ca1 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:58.588930 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-83019feb-a5c4-4f5b-9c4a-32033dab6ca1 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 92878816-6457-4392-b0bc-fb172b09fb2c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:58.595237 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-83019feb-a5c4-4f5b-9c4a-32033dab6ca1 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:58.595772 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-83019feb-a5c4-4f5b-9c4a-32033dab6ca1 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:58.596567 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-83019feb-a5c4-4f5b-9c4a-32033dab6ca1 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:58.597017 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-83019feb-a5c4-4f5b-9c4a-32033dab6ca1 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:58.724933 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-83019feb-a5c4-4f5b-9c4a-32033dab6ca1 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:58.732936 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-83019feb-a5c4-4f5b-9c4a-32033dab6ca1 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c" status: 200 len: 1513 microversion: 2.1 time: 0.148139 May 26 14:02:58.733514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 375/788] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:58 2022] GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:59.203538 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-17d6207b-5251-40cb-b66f-e0b9b2d59a54 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:59.204241 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-17d6207b-5251-40cb-b66f-e0b9b2d59a54 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:59.210624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-17d6207b-5251-40cb-b66f-e0b9b2d59a54 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:59.211061 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-17d6207b-5251-40cb-b66f-e0b9b2d59a54 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:59.211812 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-17d6207b-5251-40cb-b66f-e0b9b2d59a54 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:59.212241 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-17d6207b-5251-40cb-b66f-e0b9b2d59a54 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:59.340776 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-17d6207b-5251-40cb-b66f-e0b9b2d59a54 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:59.349586 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-17d6207b-5251-40cb-b66f-e0b9b2d59a54 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1723 microversion: 2.1 time: 0.150967 May 26 14:02:59.350147 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 414/789] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:59 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:02:59.749668 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0811c635-e8f4-4b50-972f-f892fa595c03 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:59.750271 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0811c635-e8f4-4b50-972f-f892fa595c03 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 92878816-6457-4392-b0bc-fb172b09fb2c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:59.756574 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0811c635-e8f4-4b50-972f-f892fa595c03 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:59.757027 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0811c635-e8f4-4b50-972f-f892fa595c03 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:59.757819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0811c635-e8f4-4b50-972f-f892fa595c03 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:59.758255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0811c635-e8f4-4b50-972f-f892fa595c03 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:59.884163 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0811c635-e8f4-4b50-972f-f892fa595c03 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:59.892241 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0811c635-e8f4-4b50-972f-f892fa595c03 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c" status: 200 len: 1513 microversion: 2.1 time: 0.146885 May 26 14:02:59.892870 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 376/790] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:02:59 2022] GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:00.366844 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-dba0fac9-d683-402c-9e0c-6ab5815c1f26 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:00.367452 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-dba0fac9-d683-402c-9e0c-6ab5815c1f26 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:00.373994 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dba0fac9-d683-402c-9e0c-6ab5815c1f26 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:00.374439 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dba0fac9-d683-402c-9e0c-6ab5815c1f26 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:00.375194 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dba0fac9-d683-402c-9e0c-6ab5815c1f26 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:00.375626 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dba0fac9-d683-402c-9e0c-6ab5815c1f26 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:00.510466 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-dba0fac9-d683-402c-9e0c-6ab5815c1f26 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:00.518467 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-dba0fac9-d683-402c-9e0c-6ab5815c1f26 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1723 microversion: 2.1 time: 0.155477 May 26 14:03:00.519285 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 415/791] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:00 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:00.910511 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-185d3e53-0830-4f70-a431-34a57ede8531 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:00.911059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-185d3e53-0830-4f70-a431-34a57ede8531 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 92878816-6457-4392-b0bc-fb172b09fb2c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:00.917546 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-185d3e53-0830-4f70-a431-34a57ede8531 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:00.917993 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-185d3e53-0830-4f70-a431-34a57ede8531 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:00.918755 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-185d3e53-0830-4f70-a431-34a57ede8531 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:00.919186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-185d3e53-0830-4f70-a431-34a57ede8531 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:01.044271 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-185d3e53-0830-4f70-a431-34a57ede8531 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:01.051627 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-185d3e53-0830-4f70-a431-34a57ede8531 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c" status: 200 len: 1513 microversion: 2.1 time: 0.145038 May 26 14:03:01.052187 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 377/792] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:00 2022] GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c => generated 1513 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:01.536036 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d01bcd01-79d1-46c6-8f6d-41800dfe5a0f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:01.536590 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d01bcd01-79d1-46c6-8f6d-41800dfe5a0f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:01.543574 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d01bcd01-79d1-46c6-8f6d-41800dfe5a0f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:01.544014 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d01bcd01-79d1-46c6-8f6d-41800dfe5a0f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:01.545432 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d01bcd01-79d1-46c6-8f6d-41800dfe5a0f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:01.545865 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d01bcd01-79d1-46c6-8f6d-41800dfe5a0f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:01.675204 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d01bcd01-79d1-46c6-8f6d-41800dfe5a0f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:01.683220 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d01bcd01-79d1-46c6-8f6d-41800dfe5a0f tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1723 microversion: 2.1 time: 0.151216 May 26 14:03:01.683788 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 416/793] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:01 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:02.068608 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-02831ce4-ad10-4305-b78d-6b7671e9b82b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:02.069279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-02831ce4-ad10-4305-b78d-6b7671e9b82b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 92878816-6457-4392-b0bc-fb172b09fb2c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:02.075829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02831ce4-ad10-4305-b78d-6b7671e9b82b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:02.076317 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02831ce4-ad10-4305-b78d-6b7671e9b82b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:02.077083 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02831ce4-ad10-4305-b78d-6b7671e9b82b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:02.077546 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02831ce4-ad10-4305-b78d-6b7671e9b82b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:02.205283 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-02831ce4-ad10-4305-b78d-6b7671e9b82b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:02.213314 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-02831ce4-ad10-4305-b78d-6b7671e9b82b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c" status: 200 len: 1513 microversion: 2.1 time: 0.148581 May 26 14:03:02.213878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 378/794] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:02 2022] GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:02.702228 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cf0ba193-ae12-4217-bc92-aeaf1be1648d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:02.702839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-cf0ba193-ae12-4217-bc92-aeaf1be1648d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:02.709331 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cf0ba193-ae12-4217-bc92-aeaf1be1648d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:02.709784 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cf0ba193-ae12-4217-bc92-aeaf1be1648d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:02.710547 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cf0ba193-ae12-4217-bc92-aeaf1be1648d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:02.710986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cf0ba193-ae12-4217-bc92-aeaf1be1648d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:02.837191 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cf0ba193-ae12-4217-bc92-aeaf1be1648d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:02.845066 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-cf0ba193-ae12-4217-bc92-aeaf1be1648d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1723 microversion: 2.1 time: 0.147288 May 26 14:03:02.845667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 417/795] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:02 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:03.230673 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b6cbd949-c8a7-4346-aff7-fb348f1f2225 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:03.231289 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b6cbd949-c8a7-4346-aff7-fb348f1f2225 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 92878816-6457-4392-b0bc-fb172b09fb2c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:03.238184 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b6cbd949-c8a7-4346-aff7-fb348f1f2225 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:03.238639 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b6cbd949-c8a7-4346-aff7-fb348f1f2225 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:03.239409 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b6cbd949-c8a7-4346-aff7-fb348f1f2225 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:03.239852 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b6cbd949-c8a7-4346-aff7-fb348f1f2225 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:03.371848 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b6cbd949-c8a7-4346-aff7-fb348f1f2225 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:03.379350 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b6cbd949-c8a7-4346-aff7-fb348f1f2225 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c" status: 200 len: 1513 microversion: 2.1 time: 0.152578 May 26 14:03:03.379906 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 379/796] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:03 2022] GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:03.862732 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d2a95f60-50c9-403a-9ec5-652c0b04d18d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:03.863925 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d2a95f60-50c9-403a-9ec5-652c0b04d18d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:03.871053 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2a95f60-50c9-403a-9ec5-652c0b04d18d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:03.871824 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2a95f60-50c9-403a-9ec5-652c0b04d18d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:03.873484 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2a95f60-50c9-403a-9ec5-652c0b04d18d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:03.874032 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2a95f60-50c9-403a-9ec5-652c0b04d18d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:04.007224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d2a95f60-50c9-403a-9ec5-652c0b04d18d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:04.016174 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d2a95f60-50c9-403a-9ec5-652c0b04d18d tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1729 microversion: 2.1 time: 0.157166 May 26 14:03:04.016891 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 418/797] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:03 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:04.033335 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7a6c2e83-3f0a-44a6-bfe2-ce01cad55292 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:04.033837 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7a6c2e83-3f0a-44a6-bfe2-ce01cad55292 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:04.039696 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7a6c2e83-3f0a-44a6-bfe2-ce01cad55292 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:04.040154 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7a6c2e83-3f0a-44a6-bfe2-ce01cad55292 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:04.040928 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7a6c2e83-3f0a-44a6-bfe2-ce01cad55292 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:04.041461 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7a6c2e83-3f0a-44a6-bfe2-ce01cad55292 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:04.131502 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7a6c2e83-3f0a-44a6-bfe2-ce01cad55292 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101986 May 26 14:03:04.132182 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 380/798] 10.222.0.91 () {58 vars in 1274 bytes} [Thu May 26 14:03:04 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:03:04.167914 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-b8beb5c2-ffec-4155-b750-380d0c8fa473 req-363c7a5b-d8e1-4516-80ce-c9f0d66aac30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92878816-6457-4392-b0bc-fb172b09fb2c", "name": "network-vif-deleted", "tag": "34f5dafc-2456-45ca-8aa3-b0e00e47f747"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:03:04.176590 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-b8beb5c2-ffec-4155-b750-380d0c8fa473 req-363c7a5b-d8e1-4516-80ce-c9f0d66aac30 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:04.177101 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-b8beb5c2-ffec-4155-b750-380d0c8fa473 req-363c7a5b-d8e1-4516-80ce-c9f0d66aac30 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:04.189053 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-b8beb5c2-ffec-4155-b750-380d0c8fa473 req-363c7a5b-d8e1-4516-80ce-c9f0d66aac30 service nova] Creating event network-vif-deleted:34f5dafc-2456-45ca-8aa3-b0e00e47f747 for instance 92878816-6457-4392-b0bc-fb172b09fb2c on hv-cinder-84213 May 26 14:03:04.194180 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-b8beb5c2-ffec-4155-b750-380d0c8fa473 req-363c7a5b-d8e1-4516-80ce-c9f0d66aac30 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029849 May 26 14:03:04.197687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 419/799] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:03:04.397250 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7b23fc94-6e4e-474b-88c8-a202344b862b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:04.397839 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7b23fc94-6e4e-474b-88c8-a202344b862b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 92878816-6457-4392-b0bc-fb172b09fb2c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:04.403891 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7b23fc94-6e4e-474b-88c8-a202344b862b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:04.404343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7b23fc94-6e4e-474b-88c8-a202344b862b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:04.405120 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7b23fc94-6e4e-474b-88c8-a202344b862b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:04.405591 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7b23fc94-6e4e-474b-88c8-a202344b862b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:04.446466 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7b23fc94-6e4e-474b-88c8-a202344b862b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:04.446928 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7b23fc94-6e4e-474b-88c8-a202344b862b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:04.447393 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-7b23fc94-6e4e-474b-88c8-a202344b862b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lazy-loading 'fault' on Instance uuid 92878816-6457-4392-b0bc-fb172b09fb2c {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:03:04.496010 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7b23fc94-6e4e-474b-88c8-a202344b862b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:04.504589 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7b23fc94-6e4e-474b-88c8-a202344b862b tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c" status: 200 len: 1309 microversion: 2.1 time: 0.112139 May 26 14:03:04.505178 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 381/800] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:04 2022] GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c => generated 1309 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:05.094692 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-7d24fa56-0c2f-473d-8f09-68ab7ed4659a req-fdade3a0-7a4a-4a28-9100-38ccf9e4afd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa89e8ed-11d3-42d2-b030-5b7497694471", "tag": "325f8a3e-5419-43f8-a8e8-0067da401f65"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:03:05.103265 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-7d24fa56-0c2f-473d-8f09-68ab7ed4659a req-fdade3a0-7a4a-4a28-9100-38ccf9e4afd0 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:05.103809 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-7d24fa56-0c2f-473d-8f09-68ab7ed4659a req-fdade3a0-7a4a-4a28-9100-38ccf9e4afd0 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:05.115349 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-7d24fa56-0c2f-473d-8f09-68ab7ed4659a req-fdade3a0-7a4a-4a28-9100-38ccf9e4afd0 service nova] Creating event network-changed:325f8a3e-5419-43f8-a8e8-0067da401f65 for instance aa89e8ed-11d3-42d2-b030-5b7497694471 on hv-cinder-84213 May 26 14:03:05.120278 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-7d24fa56-0c2f-473d-8f09-68ab7ed4659a req-fdade3a0-7a4a-4a28-9100-38ccf9e4afd0 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088857 May 26 14:03:05.120966 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 420/801] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:03:05.520807 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1adad088-c7ba-4e55-a9e7-7518f0c0503d tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:05.521914 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1adad088-c7ba-4e55-a9e7-7518f0c0503d tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 92878816-6457-4392-b0bc-fb172b09fb2c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:05.528697 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1adad088-c7ba-4e55-a9e7-7518f0c0503d tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:05.529896 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1adad088-c7ba-4e55-a9e7-7518f0c0503d tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:05.530789 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1adad088-c7ba-4e55-a9e7-7518f0c0503d tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:05.531372 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1adad088-c7ba-4e55-a9e7-7518f0c0503d tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:05.547329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-1adad088-c7ba-4e55-a9e7-7518f0c0503d tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] HTTP exception thrown: Instance 92878816-6457-4392-b0bc-fb172b09fb2c could not be found. May 26 14:03:05.549072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1adad088-c7ba-4e55-a9e7-7518f0c0503d tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Request method failure captured: May 26 14:03:05.549072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c HTTP/1.1 May 26 14:03:05.549072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 14:03:05.549072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 14:03:05.549072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 14:03:05.549072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 14:03:05.549072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 14:03:05.549072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 14:03:05.549072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 14:03:05.549072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 14:03:05.549072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4hHtI85T4iYTReeyKyp0Zs3RnarImaZnY6B-2gt8EquQ5EddwDc2kuTf2TX72VJ3TzKQKfrR1sSjdkT9CfUjC1PRIZam3wS0h9n4uGYYFvE0uAidwTbrDI2syGyBsgg--vETEexOrjnYclNr44oDLYSqWDDAj9lq4Z4asGpJFv2l78 May 26 14:03:05.549072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 14:03:05.549072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 14:03:05.549072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 14:03:05.549072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 14:03:05.549072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 14:03:05.549072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 14:03:05.549072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: 98a1b861d3d84f309ff5a1e90f7499fd May 26 14:03:05.549072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1677528382 May 26 14:03:05.549072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 14:03:05.549072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 14:03:05.550751 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/98a1b861d3d84f309ff5a1e90f7499fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/98a1b861d3d84f309ff5a1e90f7499fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/98a1b861d3d84f309ff5a1e90f7499fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_98a1b861d3d84f309ff5a1e90f7499fd", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:03:05.550751 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesSnapshotTestJSON-1677528382 May 26 14:03:05.550751 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 98a1b861d3d84f309ff5a1e90f7499fd May 26 14:03:05.550751 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1677528382 May 26 14:03:05.550751 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesSnapshotTestJSON-1677528382-project May 26 14:03:05.550751 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 14:03:05.550751 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 14:03:05.550751 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: d3425e6afcbf4d20bf4229ba6d93c8ff May 26 14:03:05.550751 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesSnapshotTestJSON-1677528382-project May 26 14:03:05.550751 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: > May 26 14:03:05.550751 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Instance 92878816-6457-4392-b0bc-fb172b09fb2c could not be found. May 26 14:03:05.550751 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'id': '92878816-6457-4392-b0bc-fb172b09fb2c'} May 26 14:03:05.551716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:03:05.551716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:03:05.551716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:03:05.551716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:03:05.551716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:03:05.551716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:03:05.551716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:03:05.551716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:03:05.551716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:03:05.551716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:03:05.551716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92878816-6457-4392-b0bc-fb172b09fb2c could not be found. May 26 14:03:05.551716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:03:05.551716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:03:05.551716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:03:05.551716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:03:05.551716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:03:05.551716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:03:05.551716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:03:05.551716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:03:05.551716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:03:05.553134 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:03:05.553134 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:03:05.553134 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:03:05.553134 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:03:05.553134 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:03:05.553134 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:03:05.553134 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:03:05.553134 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92878816-6457-4392-b0bc-fb172b09fb2c could not be found. May 26 14:03:05.553134 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:03:05.553134 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:03:05.553134 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:03:05.553134 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:03:05.553134 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:03:05.553134 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:03:05.553134 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:03:05.553134 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:03:05.553134 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92878816-6457-4392-b0bc-fb172b09fb2c could not be found. May 26 14:03:05.553134 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:03:05.555174 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1adad088-c7ba-4e55-a9e7-7518f0c0503d tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Returning 404 to user: Instance 92878816-6457-4392-b0bc-fb172b09fb2c could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:03:05.555174 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1adad088-c7ba-4e55-a9e7-7518f0c0503d tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c" status: 404 len: 111 microversion: 2.1 time: 0.035462 May 26 14:03:05.555174 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 382/802] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:05 2022] GET /compute/v2.1/servers/92878816-6457-4392-b0bc-fb172b09fb2c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:03:07.134702 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-31b86804-bbbc-4b90-bec6-5c8beac7b26f req-22de2380-bf09-4bf6-97c7-b900f04893ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa89e8ed-11d3-42d2-b030-5b7497694471", "tag": "325f8a3e-5419-43f8-a8e8-0067da401f65"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:03:07.144511 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-31b86804-bbbc-4b90-bec6-5c8beac7b26f req-22de2380-bf09-4bf6-97c7-b900f04893ca service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:07.144949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-31b86804-bbbc-4b90-bec6-5c8beac7b26f req-22de2380-bf09-4bf6-97c7-b900f04893ca service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:07.155392 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-31b86804-bbbc-4b90-bec6-5c8beac7b26f req-22de2380-bf09-4bf6-97c7-b900f04893ca service nova] Creating event network-changed:325f8a3e-5419-43f8-a8e8-0067da401f65 for instance aa89e8ed-11d3-42d2-b030-5b7497694471 on hv-cinder-84213 May 26 14:03:07.160216 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-31b86804-bbbc-4b90-bec6-5c8beac7b26f req-22de2380-bf09-4bf6-97c7-b900f04893ca service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029553 May 26 14:03:07.160781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 421/803] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:03:09.162444 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ec1e19f4-d870-42f5-9de4-1bbfe8836557 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:09.163571 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ec1e19f4-d870-42f5-9de4-1bbfe8836557 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:09.169556 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ec1e19f4-d870-42f5-9de4-1bbfe8836557 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:09.170023 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ec1e19f4-d870-42f5-9de4-1bbfe8836557 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:09.171258 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ec1e19f4-d870-42f5-9de4-1bbfe8836557 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:09.171703 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ec1e19f4-d870-42f5-9de4-1bbfe8836557 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:09.195186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ec1e19f4-d870-42f5-9de4-1bbfe8836557 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0/ips" status: 200 len: 151 microversion: 2.1 time: 0.135380 May 26 14:03:09.196156 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 383/804] 10.222.0.91 () {58 vars in 1247 bytes} [Thu May 26 14:03:09 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0/ips => generated 151 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:03:09.207266 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3f46ab10-cfa9-45f8-acc4-854cf88f58fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12d5cd19-1034-4f44-a7a8-6c4c87007719"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:03:09.208647 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3f46ab10-cfa9-45f8-acc4-854cf88f58fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:09.214849 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3f46ab10-cfa9-45f8-acc4-854cf88f58fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:09.215296 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3f46ab10-cfa9-45f8-acc4-854cf88f58fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:09.216057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3f46ab10-cfa9-45f8-acc4-854cf88f58fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:09.216489 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3f46ab10-cfa9-45f8-acc4-854cf88f58fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:09.230346 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:09.299314 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-3f46ab10-cfa9-45f8-acc4-854cf88f58fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] HTTP exception thrown: Invalid volume: volume 12d5cd19-1034-4f44-a7a8-6c4c87007719 is already attached to instances: 71af8283-a8f5-44e7-bdcd-6606070472b2 May 26 14:03:09.301057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3f46ab10-cfa9-45f8-acc4-854cf88f58fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Request method failure captured: May 26 14:03:09.301057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: POST /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0/os-volume_attachments HTTP/1.1 May 26 14:03:09.301057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 14:03:09.301057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 14:03:09.301057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 14:03:09.301057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 74 May 26 14:03:09.301057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 14:03:09.301057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 14:03:09.301057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 14:03:09.301057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 14:03:09.301057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4b__678MF1xn-Y-FCgJA6efvs1BUPOjPQR7CX8Syda7vzr5d1CdCh5DI87op5BdIZCVD07V82_W1yg69L4heAf3g2lspOZA26PnKf-_EHlLlY2PFv6bdndxAuwButuA1UEOsadDnC15207Ae7Gdf_dlN6YFnL_d6Ys4jSw91hHf8Ro May 26 14:03:09.301057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 14:03:09.301057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 14:03:09.301057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 14:03:09.301057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 14:03:09.301057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 14:03:09.301057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 14:03:09.301057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:03:09.301057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:03:09.301057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 14:03:09.301057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 14:03:09.302676 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_af9d168c40ea4df99b495eb06245d066", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:03:09.302676 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:03:09.302676 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:03:09.302676 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:03:09.302676 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:03:09.302676 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 14:03:09.302676 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 14:03:09.302676 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: 592975b43454407abde6c7cab2504982 May 26 14:03:09.302676 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:03:09.302676 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: May 26 14:03:09.302676 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {"volumeAttachment": {"volumeId": "12d5cd19-1034-4f44-a7a8-6c4c87007719"}} May 26 14:03:09.302676 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 14:03:09.303602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Invalid volume: volume 12d5cd19-1034-4f44-a7a8-6c4c87007719 is already attached to instances: 71af8283-a8f5-44e7-bdcd-6606070472b2 May 26 14:03:09.303602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'server_id': '40c8745d-a394-4026-a5c4-b5ce4c5590e0', 'body': {'volumeAttachment': {'volumeId': '12d5cd19-1034-4f44-a7a8-6c4c87007719'}}} May 26 14:03:09.303602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:03:09.303602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:03:09.303602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 14:03:09.303602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 14:03:09.303602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 14:03:09.303602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 14:03:09.303602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 14:03:09.303602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 14:03:09.303602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 14:03:09.303602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 14:03:09.303602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 14:03:09.303602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 14:03:09.303602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 12d5cd19-1034-4f44-a7a8-6c4c87007719 is already attached to instances: 71af8283-a8f5-44e7-bdcd-6606070472b2 May 26 14:03:09.303602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:03:09.303602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:03:09.303602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:03:09.303602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:03:09.305002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:03:09.305002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:03:09.305002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:03:09.305002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:03:09.305002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:03:09.305002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:03:09.305002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 14:03:09.305002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 14:03:09.305002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 14:03:09.305002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 14:03:09.305002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 14:03:09.305002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 14:03:09.305002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 14:03:09.305002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 14:03:09.305002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 12d5cd19-1034-4f44-a7a8-6c4c87007719 is already attached to instances: 71af8283-a8f5-44e7-bdcd-6606070472b2 May 26 14:03:09.305002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:03:09.305002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:03:09.305002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:03:09.305002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:03:09.305002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:03:09.306580 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:03:09.306580 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:03:09.306580 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:03:09.306580 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 12d5cd19-1034-4f44-a7a8-6c4c87007719 is already attached to instances: 71af8283-a8f5-44e7-bdcd-6606070472b2 May 26 14:03:09.306580 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:03:09.306580 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3f46ab10-cfa9-45f8-acc4-854cf88f58fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Returning 400 to user: Invalid volume: volume 12d5cd19-1034-4f44-a7a8-6c4c87007719 is already attached to instances: 71af8283-a8f5-44e7-bdcd-6606070472b2 {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:03:09.306580 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3f46ab10-cfa9-45f8-acc4-854cf88f58fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "POST /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100205 May 26 14:03:09.306580 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 422/805] 10.222.0.91 () {60 vars in 1322 bytes} [Thu May 26 14:03:09 2022] POST /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 14:03:09.312105 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9f5704f4-0248-4df0-b13e-842f1b369c2e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:09.312392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9f5704f4-0248-4df0-b13e-842f1b369c2e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:09.318415 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9f5704f4-0248-4df0-b13e-842f1b369c2e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:09.318860 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9f5704f4-0248-4df0-b13e-842f1b369c2e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:09.319616 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9f5704f4-0248-4df0-b13e-842f1b369c2e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:09.320052 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9f5704f4-0248-4df0-b13e-842f1b369c2e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:09.344947 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9f5704f4-0248-4df0-b13e-842f1b369c2e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 14:03:09.421909 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9f5704f4-0248-4df0-b13e-842f1b369c2e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "DELETE /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 204 len: 0 microversion: 2.1 time: 0.114023 May 26 14:03:09.422964 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 384/806] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 14:03:09 2022] DELETE /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 14:03:09.431133 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8afbd008-b706-4eac-aa6e-30a92d2f13a6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:09.431879 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8afbd008-b706-4eac-aa6e-30a92d2f13a6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:09.441874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8afbd008-b706-4eac-aa6e-30a92d2f13a6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:09.442338 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8afbd008-b706-4eac-aa6e-30a92d2f13a6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:09.443248 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8afbd008-b706-4eac-aa6e-30a92d2f13a6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:09.443972 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8afbd008-b706-4eac-aa6e-30a92d2f13a6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:09.575946 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8afbd008-b706-4eac-aa6e-30a92d2f13a6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:09.584020 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8afbd008-b706-4eac-aa6e-30a92d2f13a6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1682 microversion: 2.1 time: 0.156793 May 26 14:03:09.584588 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 423/807] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:09 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:10.602997 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-95eec3c0-6f31-4123-a21a-93ee410f8d00 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:10.603622 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-95eec3c0-6f31-4123-a21a-93ee410f8d00 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:10.610088 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-95eec3c0-6f31-4123-a21a-93ee410f8d00 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:10.610538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-95eec3c0-6f31-4123-a21a-93ee410f8d00 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:10.611308 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-95eec3c0-6f31-4123-a21a-93ee410f8d00 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:10.611751 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-95eec3c0-6f31-4123-a21a-93ee410f8d00 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:10.747291 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-95eec3c0-6f31-4123-a21a-93ee410f8d00 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:10.757024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-95eec3c0-6f31-4123-a21a-93ee410f8d00 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1682 microversion: 2.1 time: 0.158315 May 26 14:03:10.757624 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 385/808] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:10 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:11.775579 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-205d4c46-fefc-4fca-bb88-321ea1405e43 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:11.776403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-205d4c46-fefc-4fca-bb88-321ea1405e43 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:11.787364 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-205d4c46-fefc-4fca-bb88-321ea1405e43 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:11.788107 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-205d4c46-fefc-4fca-bb88-321ea1405e43 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:11.788828 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-205d4c46-fefc-4fca-bb88-321ea1405e43 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:11.789449 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-205d4c46-fefc-4fca-bb88-321ea1405e43 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:12.075405 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-205d4c46-fefc-4fca-bb88-321ea1405e43 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:12.083919 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-205d4c46-fefc-4fca-bb88-321ea1405e43 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1682 microversion: 2.1 time: 0.312142 May 26 14:03:12.084508 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 424/809] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:11 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1682 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:12.597269 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-15ea84f9-a204-43c3-b97a-0b2b637631de req-925a29f6-dbfe-48f3-9a96-e27d496fbf39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c8745d-a394-4026-a5c4-b5ce4c5590e0", "name": "network-vif-deleted", "tag": "3d450e70-f1c7-407d-adbd-6d7812d913c3"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:03:12.606442 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-15ea84f9-a204-43c3-b97a-0b2b637631de req-925a29f6-dbfe-48f3-9a96-e27d496fbf39 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:12.607216 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-15ea84f9-a204-43c3-b97a-0b2b637631de req-925a29f6-dbfe-48f3-9a96-e27d496fbf39 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:12.620240 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-15ea84f9-a204-43c3-b97a-0b2b637631de req-925a29f6-dbfe-48f3-9a96-e27d496fbf39 service nova] Creating event network-vif-deleted:3d450e70-f1c7-407d-adbd-6d7812d913c3 for instance 40c8745d-a394-4026-a5c4-b5ce4c5590e0 on hv-cinder-84213 May 26 14:03:12.626620 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-15ea84f9-a204-43c3-b97a-0b2b637631de req-925a29f6-dbfe-48f3-9a96-e27d496fbf39 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033417 May 26 14:03:12.628541 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 386/810] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:03:13.101566 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-346ee805-e1d5-4165-babc-0a0ab5f16ea2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:13.102174 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-346ee805-e1d5-4165-babc-0a0ab5f16ea2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:13.108970 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-346ee805-e1d5-4165-babc-0a0ab5f16ea2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:13.110060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-346ee805-e1d5-4165-babc-0a0ab5f16ea2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:13.110262 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-346ee805-e1d5-4165-babc-0a0ab5f16ea2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:13.110698 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-346ee805-e1d5-4165-babc-0a0ab5f16ea2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:13.155622 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-346ee805-e1d5-4165-babc-0a0ab5f16ea2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:13.156069 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-346ee805-e1d5-4165-babc-0a0ab5f16ea2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:13.156535 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-346ee805-e1d5-4165-babc-0a0ab5f16ea2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lazy-loading 'fault' on Instance uuid 40c8745d-a394-4026-a5c4-b5ce4c5590e0 {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:03:13.205110 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-346ee805-e1d5-4165-babc-0a0ab5f16ea2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:13.212659 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-346ee805-e1d5-4165-babc-0a0ab5f16ea2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1330 microversion: 2.1 time: 0.114966 May 26 14:03:13.213258 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 425/811] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:13 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1330 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:14.230585 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b992c262-0642-4d61-99bb-86a48f1b9384 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:14.231349 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b992c262-0642-4d61-99bb-86a48f1b9384 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:14.237543 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b992c262-0642-4d61-99bb-86a48f1b9384 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:14.237992 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b992c262-0642-4d61-99bb-86a48f1b9384 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:14.238922 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b992c262-0642-4d61-99bb-86a48f1b9384 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:14.239360 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b992c262-0642-4d61-99bb-86a48f1b9384 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:14.272354 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b992c262-0642-4d61-99bb-86a48f1b9384 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:14.272792 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b992c262-0642-4d61-99bb-86a48f1b9384 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:14.273257 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-b992c262-0642-4d61-99bb-86a48f1b9384 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lazy-loading 'fault' on Instance uuid 40c8745d-a394-4026-a5c4-b5ce4c5590e0 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:03:14.314328 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b992c262-0642-4d61-99bb-86a48f1b9384 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:14.321760 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b992c262-0642-4d61-99bb-86a48f1b9384 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1330 microversion: 2.1 time: 0.095972 May 26 14:03:14.322547 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 387/812] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:14 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:15.339198 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d6de18a6-a71d-4d05-8c4f-948ce2921698 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:15.339788 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d6de18a6-a71d-4d05-8c4f-948ce2921698 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:15.347012 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d6de18a6-a71d-4d05-8c4f-948ce2921698 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:15.347456 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d6de18a6-a71d-4d05-8c4f-948ce2921698 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:15.348214 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d6de18a6-a71d-4d05-8c4f-948ce2921698 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:15.348641 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d6de18a6-a71d-4d05-8c4f-948ce2921698 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:15.379423 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d6de18a6-a71d-4d05-8c4f-948ce2921698 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:15.379866 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d6de18a6-a71d-4d05-8c4f-948ce2921698 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:15.380308 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-d6de18a6-a71d-4d05-8c4f-948ce2921698 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lazy-loading 'fault' on Instance uuid 40c8745d-a394-4026-a5c4-b5ce4c5590e0 {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:03:15.426366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d6de18a6-a71d-4d05-8c4f-948ce2921698 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:15.434379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d6de18a6-a71d-4d05-8c4f-948ce2921698 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1330 microversion: 2.1 time: 0.099039 May 26 14:03:15.434971 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 426/813] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:15 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1330 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:15.636495 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:03:15.636688 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Thu May 26 14:03:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 14:03:16.462304 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1d97af8a-fb12-49fe-9a23-3d88090dd936 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:16.462304 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1d97af8a-fb12-49fe-9a23-3d88090dd936 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:16.462304 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d97af8a-fb12-49fe-9a23-3d88090dd936 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:16.462304 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d97af8a-fb12-49fe-9a23-3d88090dd936 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:16.463021 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d97af8a-fb12-49fe-9a23-3d88090dd936 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:16.463021 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d97af8a-fb12-49fe-9a23-3d88090dd936 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:16.498965 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d97af8a-fb12-49fe-9a23-3d88090dd936 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:16.499442 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d97af8a-fb12-49fe-9a23-3d88090dd936 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:16.499981 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-1d97af8a-fb12-49fe-9a23-3d88090dd936 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lazy-loading 'fault' on Instance uuid 40c8745d-a394-4026-a5c4-b5ce4c5590e0 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:03:16.504873 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:16.555385 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1d97af8a-fb12-49fe-9a23-3d88090dd936 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:16.563363 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d07e8534-d798-45d2-8f2e-414e3e195bbe tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-49786575", "imageRef": "bcaacfae-fe2c-455f-a6e1-b08361c6fa8c", "flavorRef": "452", "networks": [{"uuid": "bbfc7162-50f8-45cc-990c-7477113944aa"}]}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:03:16.564462 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1d97af8a-fb12-49fe-9a23-3d88090dd936 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 200 len: 1330 microversion: 2.1 time: 0.116678 May 26 14:03:16.565350 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 388/814] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:16 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 1330 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:16.620615 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-d07e8534-d798-45d2-8f2e-414e3e195bbe tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] validate_networks() for [('bbfc7162-50f8-45cc-990c-7477113944aa', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 14:03:16.959410 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-d07e8534-d798-45d2-8f2e-414e3e195bbe tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 14:03:16.959838 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-d07e8534-d798-45d2-8f2e-414e3e195bbe tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 14:03:16.960310 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-d07e8534-d798-45d2-8f2e-414e3e195bbe tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 14:03:16.960717 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-d07e8534-d798-45d2-8f2e-414e3e195bbe tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 14:03:16.961249 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-d07e8534-d798-45d2-8f2e-414e3e195bbe tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 14:03:16.970956 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d07e8534-d798-45d2-8f2e-414e3e195bbe tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:16.972032 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d07e8534-d798-45d2-8f2e-414e3e195bbe tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:16.973024 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d07e8534-d798-45d2-8f2e-414e3e195bbe tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:16.973647 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d07e8534-d798-45d2-8f2e-414e3e195bbe tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:16.992284 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-d07e8534-d798-45d2-8f2e-414e3e195bbe tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Getting quotas for project 98a1b861d3d84f309ff5a1e90f7499fd. Resources: {'ram', 'cores', 'instances'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 14:03:16.997753 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-d07e8534-d798-45d2-8f2e-414e3e195bbe tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Getting quotas for user d3425e6afcbf4d20bf4229ba6d93c8ff and project 98a1b861d3d84f309ff5a1e90f7499fd. Resources: {'ram', 'cores', 'instances'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 14:03:17.010416 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d07e8534-d798-45d2-8f2e-414e3e195bbe tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 14:03:17.012827 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d07e8534-d798-45d2-8f2e-414e3e195bbe tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 62e69036-90a3-4f5d-a79e-74bc3dc4467c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bcaacfae-fe2c-455f-a6e1-b08361c6fa8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 14:03:17.063188 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d07e8534-d798-45d2-8f2e-414e3e195bbe tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504048 May 26 14:03:17.063828 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 427/815] 10.222.0.91 () {60 vars in 1146 bytes} [Thu May 26 14:03:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 14:03:17.073875 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cf54f16e-f8c7-4507-bf8f-db4c90e20c0d tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:17.074483 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cf54f16e-f8c7-4507-bf8f-db4c90e20c0d tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 62e69036-90a3-4f5d-a79e-74bc3dc4467c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:17.131642 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cf54f16e-f8c7-4507-bf8f-db4c90e20c0d tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:17.138531 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cf54f16e-f8c7-4507-bf8f-db4c90e20c0d tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c" status: 200 len: 1217 microversion: 2.1 time: 0.068491 May 26 14:03:17.139735 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 389/816] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:17 2022] GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:17.581443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-975ea212-d7ea-4e91-8c63-17b647c41358 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:17.582073 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-975ea212-d7ea-4e91-8c63-17b647c41358 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:17.589181 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-975ea212-d7ea-4e91-8c63-17b647c41358 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:17.589823 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-975ea212-d7ea-4e91-8c63-17b647c41358 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:17.590394 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-975ea212-d7ea-4e91-8c63-17b647c41358 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:17.590815 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-975ea212-d7ea-4e91-8c63-17b647c41358 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:17.604506 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-975ea212-d7ea-4e91-8c63-17b647c41358 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] HTTP exception thrown: Instance 40c8745d-a394-4026-a5c4-b5ce4c5590e0 could not be found. May 26 14:03:17.606060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-975ea212-d7ea-4e91-8c63-17b647c41358 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Request method failure captured: May 26 14:03:17.606060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 HTTP/1.1 May 26 14:03:17.606060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 14:03:17.606060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 14:03:17.606060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 14:03:17.606060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 14:03:17.606060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 14:03:17.606060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 14:03:17.606060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 14:03:17.606060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 14:03:17.606060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4b__678MF1xn-Y-FCgJA6efvs1BUPOjPQR7CX8Syda7vzr5d1CdCh5DI87op5BdIZCVD07V82_W1yg69L4heAf3g2lspOZA26PnKf-_EHlLlY2PFv6bdndxAuwButuA1UEOsadDnC15207Ae7Gdf_dlN6YFnL_d6Ys4jSw91hHf8Ro May 26 14:03:17.606060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 14:03:17.606060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 14:03:17.606060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 14:03:17.606060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 14:03:17.606060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 14:03:17.606060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 14:03:17.606060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:03:17.606060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:03:17.606060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 14:03:17.606060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 14:03:17.607662 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_af9d168c40ea4df99b495eb06245d066", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:03:17.607662 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:03:17.607662 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:03:17.607662 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:03:17.607662 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:03:17.607662 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 14:03:17.607662 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 14:03:17.607662 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: 592975b43454407abde6c7cab2504982 May 26 14:03:17.607662 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:03:17.607662 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 14:03:17.607662 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Instance 40c8745d-a394-4026-a5c4-b5ce4c5590e0 could not be found. May 26 14:03:17.607662 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': '40c8745d-a394-4026-a5c4-b5ce4c5590e0'} May 26 14:03:17.609028 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:03:17.609028 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:03:17.609028 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:03:17.609028 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:03:17.609028 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:03:17.609028 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:03:17.609028 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:03:17.609028 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:03:17.609028 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:03:17.609028 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:03:17.609028 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40c8745d-a394-4026-a5c4-b5ce4c5590e0 could not be found. May 26 14:03:17.609028 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:03:17.609028 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:03:17.609028 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:03:17.609028 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:03:17.609028 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:03:17.609028 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:03:17.609028 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:03:17.609028 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:03:17.609028 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:03:17.611707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:03:17.611707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:03:17.611707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:03:17.611707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:03:17.611707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:03:17.611707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:03:17.611707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:03:17.611707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40c8745d-a394-4026-a5c4-b5ce4c5590e0 could not be found. May 26 14:03:17.611707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:03:17.611707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:03:17.611707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:03:17.611707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:03:17.611707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:03:17.611707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:03:17.611707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:03:17.611707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:03:17.611707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40c8745d-a394-4026-a5c4-b5ce4c5590e0 could not be found. May 26 14:03:17.611707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:03:17.614107 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-975ea212-d7ea-4e91-8c63-17b647c41358 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Returning 404 to user: Instance 40c8745d-a394-4026-a5c4-b5ce4c5590e0 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:03:17.614107 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-975ea212-d7ea-4e91-8c63-17b647c41358 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 404 len: 111 microversion: 2.1 time: 0.030040 May 26 14:03:17.614107 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 428/817] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:17 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:03:17.623837 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-28d40233-7d2b-4efe-a598-3b2d51c36f7e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '.version_select at 0x7f25a4b88ee0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:17.646725 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-28d40233-7d2b-4efe-a598-3b2d51c36f7e tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1630475897" status: 202 len: 0 microversion: 2.1 time: 0.027581 May 26 14:03:17.647310 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 390/818] 10.222.0.91 () {58 vars in 1220 bytes} [Thu May 26 14:03:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1630475897 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:03:18.159384 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f1df76c1-53b6-4dc6-a173-a451ece17386 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:18.160648 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f1df76c1-53b6-4dc6-a173-a451ece17386 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 62e69036-90a3-4f5d-a79e-74bc3dc4467c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:18.167911 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1df76c1-53b6-4dc6-a173-a451ece17386 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:18.168934 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1df76c1-53b6-4dc6-a173-a451ece17386 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:18.170024 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1df76c1-53b6-4dc6-a173-a451ece17386 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:18.170907 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1df76c1-53b6-4dc6-a173-a451ece17386 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:18.279417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f1df76c1-53b6-4dc6-a173-a451ece17386 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:18.287683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f1df76c1-53b6-4dc6-a173-a451ece17386 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c" status: 200 len: 1287 microversion: 2.1 time: 0.135241 May 26 14:03:18.288789 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 429/819] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:18 2022] GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c => generated 1287 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:18.573251 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-307c0529-de16-4a08-8c31-24d8035532a5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:18.573745 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-307c0529-de16-4a08-8c31-24d8035532a5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:18.579981 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-307c0529-de16-4a08-8c31-24d8035532a5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:18.580427 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-307c0529-de16-4a08-8c31-24d8035532a5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:18.581231 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-307c0529-de16-4a08-8c31-24d8035532a5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:18.581839 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-307c0529-de16-4a08-8c31-24d8035532a5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:18.667598 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-307c0529-de16-4a08-8c31-24d8035532a5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lazy-loading 'services' on Instance uuid 71af8283-a8f5-44e7-bdcd-6606070472b2 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:03:18.784429 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-307c0529-de16-4a08-8c31-24d8035532a5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "DELETE /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2/os-volume_attachments/12d5cd19-1034-4f44-a7a8-6c4c87007719" status: 202 len: 0 microversion: 2.1 time: 0.214898 May 26 14:03:18.785009 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 391/820] 10.222.0.91 () {58 vars in 1415 bytes} [Thu May 26 14:03:18 2022] DELETE /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2/os-volume_attachments/12d5cd19-1034-4f44-a7a8-6c4c87007719 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:03:18.793533 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-13eaaf48-fe26-4a22-916b-74ca2f1e0ad0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:18.794552 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-13eaaf48-fe26-4a22-916b-74ca2f1e0ad0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:18.802270 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-13eaaf48-fe26-4a22-916b-74ca2f1e0ad0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:18.802987 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-13eaaf48-fe26-4a22-916b-74ca2f1e0ad0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:18.803740 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-13eaaf48-fe26-4a22-916b-74ca2f1e0ad0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:18.804177 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-13eaaf48-fe26-4a22-916b-74ca2f1e0ad0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:18.834236 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-13eaaf48-fe26-4a22-916b-74ca2f1e0ad0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044792 May 26 14:03:18.834795 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 430/821] 10.222.0.91 () {58 vars in 1301 bytes} [Thu May 26 14:03:18 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:03:18.911031 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2dfa5185-a83f-4a5f-9e75-4ad131321719 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:03:18.912072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2dfa5185-a83f-4a5f-9e75-4ad131321719 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:18.919284 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2dfa5185-a83f-4a5f-9e75-4ad131321719 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:18.919731 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2dfa5185-a83f-4a5f-9e75-4ad131321719 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:18.921413 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2dfa5185-a83f-4a5f-9e75-4ad131321719 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:18.922011 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2dfa5185-a83f-4a5f-9e75-4ad131321719 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:19.000908 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2dfa5185-a83f-4a5f-9e75-4ad131321719 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "POST /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b/action" status: 202 len: 0 microversion: 2.1 time: 0.093978 May 26 14:03:19.001577 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 392/822] 10.222.0.91 () {60 vars in 1277 bytes} [Thu May 26 14:03:18 2022] POST /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:03:19.009793 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9c4c0441-93f6-4504-8b6b-8a6f4806fb20 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:19.010401 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9c4c0441-93f6-4504-8b6b-8a6f4806fb20 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:19.017069 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9c4c0441-93f6-4504-8b6b-8a6f4806fb20 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:19.017534 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9c4c0441-93f6-4504-8b6b-8a6f4806fb20 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:19.018768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9c4c0441-93f6-4504-8b6b-8a6f4806fb20 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:19.019279 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9c4c0441-93f6-4504-8b6b-8a6f4806fb20 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:19.278852 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9c4c0441-93f6-4504-8b6b-8a6f4806fb20 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:19.287501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9c4c0441-93f6-4504-8b6b-8a6f4806fb20 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1751 microversion: 2.1 time: 0.281639 May 26 14:03:19.295060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 431/823] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:19 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1751 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:19.306216 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-74e759b5-ce98-45b2-bca4-80b78459a96d tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:19.307140 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-74e759b5-ce98-45b2-bca4-80b78459a96d tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 62e69036-90a3-4f5d-a79e-74bc3dc4467c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:19.313542 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-74e759b5-ce98-45b2-bca4-80b78459a96d tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:19.314009 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-74e759b5-ce98-45b2-bca4-80b78459a96d tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:19.314793 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-74e759b5-ce98-45b2-bca4-80b78459a96d tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:19.315236 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-74e759b5-ce98-45b2-bca4-80b78459a96d tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:19.544321 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-74e759b5-ce98-45b2-bca4-80b78459a96d tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:19.552120 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-74e759b5-ce98-45b2-bca4-80b78459a96d tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c" status: 200 len: 1317 microversion: 2.1 time: 0.250129 May 26 14:03:19.552977 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 393/824] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:19 2022] GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:19.707371 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-0e48bc21-f7e1-4b48-8130-0bbf6e8a8a00 req-7a23952b-4842-490b-8390-88274fbd5c86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e69036-90a3-4f5d-a79e-74bc3dc4467c", "tag": "3e9da444-5e7d-4d3e-974b-0f95030b725d"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:03:19.715174 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:19.717951 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-0e48bc21-f7e1-4b48-8130-0bbf6e8a8a00 req-7a23952b-4842-490b-8390-88274fbd5c86 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:19.718574 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-0e48bc21-f7e1-4b48-8130-0bbf6e8a8a00 req-7a23952b-4842-490b-8390-88274fbd5c86 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:19.732287 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-0e48bc21-f7e1-4b48-8130-0bbf6e8a8a00 req-7a23952b-4842-490b-8390-88274fbd5c86 service nova] Creating event network-changed:3e9da444-5e7d-4d3e-974b-0f95030b725d for instance 62e69036-90a3-4f5d-a79e-74bc3dc4467c on hv-cinder-84213 May 26 14:03:19.737927 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-0e48bc21-f7e1-4b48-8130-0bbf6e8a8a00 req-7a23952b-4842-490b-8390-88274fbd5c86 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033938 May 26 14:03:19.738356 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 432/825] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:03:19.845769 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d60564a4-ea21-45a8-8ce5-d591f9beac6c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:19.846720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d60564a4-ea21-45a8-8ce5-d591f9beac6c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:19.853035 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d60564a4-ea21-45a8-8ce5-d591f9beac6c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:19.853741 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d60564a4-ea21-45a8-8ce5-d591f9beac6c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:19.854557 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d60564a4-ea21-45a8-8ce5-d591f9beac6c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:19.855003 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d60564a4-ea21-45a8-8ce5-d591f9beac6c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:19.888583 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d60564a4-ea21-45a8-8ce5-d591f9beac6c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047225 May 26 14:03:19.892748 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 394/826] 10.222.0.91 () {58 vars in 1301 bytes} [Thu May 26 14:03:19 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:03:20.305927 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fb90d949-832c-4c8d-88d4-e9380416d051 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:20.306615 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fb90d949-832c-4c8d-88d4-e9380416d051 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:20.313414 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb90d949-832c-4c8d-88d4-e9380416d051 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:20.313864 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb90d949-832c-4c8d-88d4-e9380416d051 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:20.314627 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb90d949-832c-4c8d-88d4-e9380416d051 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:20.315060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb90d949-832c-4c8d-88d4-e9380416d051 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:20.459115 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fb90d949-832c-4c8d-88d4-e9380416d051 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:20.467530 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fb90d949-832c-4c8d-88d4-e9380416d051 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1751 microversion: 2.1 time: 0.166089 May 26 14:03:20.468097 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 433/827] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:20 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:20.569536 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c51906e3-3736-49aa-8bb6-8d1fc77ebfd6 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:20.570139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c51906e3-3736-49aa-8bb6-8d1fc77ebfd6 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 62e69036-90a3-4f5d-a79e-74bc3dc4467c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:20.576035 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c51906e3-3736-49aa-8bb6-8d1fc77ebfd6 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:20.576534 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c51906e3-3736-49aa-8bb6-8d1fc77ebfd6 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:20.577312 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c51906e3-3736-49aa-8bb6-8d1fc77ebfd6 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:20.577748 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c51906e3-3736-49aa-8bb6-8d1fc77ebfd6 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:20.703031 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c51906e3-3736-49aa-8bb6-8d1fc77ebfd6 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:20.710412 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c51906e3-3736-49aa-8bb6-8d1fc77ebfd6 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c" status: 200 len: 1317 microversion: 2.1 time: 0.144676 May 26 14:03:20.710975 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 395/828] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:20 2022] GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:20.901120 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3664ea61-8b2a-48cd-8baf-bb08052c51f5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:20.902116 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3664ea61-8b2a-48cd-8baf-bb08052c51f5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:20.908891 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3664ea61-8b2a-48cd-8baf-bb08052c51f5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:20.909314 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3664ea61-8b2a-48cd-8baf-bb08052c51f5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:20.910068 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3664ea61-8b2a-48cd-8baf-bb08052c51f5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:20.910500 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3664ea61-8b2a-48cd-8baf-bb08052c51f5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:20.938416 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3664ea61-8b2a-48cd-8baf-bb08052c51f5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041223 May 26 14:03:20.938982 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 434/829] 10.222.0.91 () {58 vars in 1301 bytes} [Thu May 26 14:03:20 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 14:03:20.995699 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e1033202-c84f-476a-8417-9f5e02411a7f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:20.996199 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e1033202-c84f-476a-8417-9f5e02411a7f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:21.002595 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e1033202-c84f-476a-8417-9f5e02411a7f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:21.003045 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e1033202-c84f-476a-8417-9f5e02411a7f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:21.003814 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e1033202-c84f-476a-8417-9f5e02411a7f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:21.004255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e1033202-c84f-476a-8417-9f5e02411a7f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:21.030401 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e1033202-c84f-476a-8417-9f5e02411a7f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 14:03:21.103353 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e1033202-c84f-476a-8417-9f5e02411a7f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "DELETE /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 204 len: 0 microversion: 2.1 time: 0.111181 May 26 14:03:21.103933 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 396/830] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 14:03:20 2022] DELETE /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 14:03:21.112258 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d54dc266-c247-4eb3-949f-e4e7a554a8da tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:21.112858 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d54dc266-c247-4eb3-949f-e4e7a554a8da tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:21.118755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d54dc266-c247-4eb3-949f-e4e7a554a8da tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:21.119264 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d54dc266-c247-4eb3-949f-e4e7a554a8da tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:21.119946 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d54dc266-c247-4eb3-949f-e4e7a554a8da tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:21.120404 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d54dc266-c247-4eb3-949f-e4e7a554a8da tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:21.255933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d54dc266-c247-4eb3-949f-e4e7a554a8da tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:21.263360 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d54dc266-c247-4eb3-949f-e4e7a554a8da tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1683 microversion: 2.1 time: 0.154992 May 26 14:03:21.264535 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 435/831] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:21 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:21.485258 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2cc8b756-6b31-47e2-b64f-99c052615c4b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:21.485886 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2cc8b756-6b31-47e2-b64f-99c052615c4b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:21.492628 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2cc8b756-6b31-47e2-b64f-99c052615c4b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:21.493082 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2cc8b756-6b31-47e2-b64f-99c052615c4b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:21.493906 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2cc8b756-6b31-47e2-b64f-99c052615c4b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:21.494345 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2cc8b756-6b31-47e2-b64f-99c052615c4b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:21.638892 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2cc8b756-6b31-47e2-b64f-99c052615c4b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:21.647765 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2cc8b756-6b31-47e2-b64f-99c052615c4b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1751 microversion: 2.1 time: 0.166942 May 26 14:03:21.648354 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 397/832] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:21 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:21.727506 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-90986a63-56f4-4713-9835-21dc680c0b5e tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:21.728140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-90986a63-56f4-4713-9835-21dc680c0b5e tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 62e69036-90a3-4f5d-a79e-74bc3dc4467c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:21.735156 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-90986a63-56f4-4713-9835-21dc680c0b5e tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:21.735652 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-90986a63-56f4-4713-9835-21dc680c0b5e tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:21.736357 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-90986a63-56f4-4713-9835-21dc680c0b5e tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:21.736784 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-90986a63-56f4-4713-9835-21dc680c0b5e tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:21.865545 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-90986a63-56f4-4713-9835-21dc680c0b5e tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:21.872854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-90986a63-56f4-4713-9835-21dc680c0b5e tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c" status: 200 len: 1317 microversion: 2.1 time: 0.149143 May 26 14:03:21.874124 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 436/833] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:21 2022] GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:22.282357 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2aa32a74-3ea1-42ba-b0d9-8219e783afb5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:22.282968 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2aa32a74-3ea1-42ba-b0d9-8219e783afb5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:22.289452 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2aa32a74-3ea1-42ba-b0d9-8219e783afb5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:22.289909 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2aa32a74-3ea1-42ba-b0d9-8219e783afb5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:22.290672 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2aa32a74-3ea1-42ba-b0d9-8219e783afb5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:22.291111 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2aa32a74-3ea1-42ba-b0d9-8219e783afb5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:22.424582 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2aa32a74-3ea1-42ba-b0d9-8219e783afb5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:22.432536 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2aa32a74-3ea1-42ba-b0d9-8219e783afb5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1683 microversion: 2.1 time: 0.154580 May 26 14:03:22.433314 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 398/834] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:22 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:22.665443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-33d7a95b-ccdc-4d7d-ad92-5101c98b2d55 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:22.666052 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-33d7a95b-ccdc-4d7d-ad92-5101c98b2d55 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:22.672234 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-33d7a95b-ccdc-4d7d-ad92-5101c98b2d55 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:22.672689 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-33d7a95b-ccdc-4d7d-ad92-5101c98b2d55 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:22.673497 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-33d7a95b-ccdc-4d7d-ad92-5101c98b2d55 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:22.673944 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-33d7a95b-ccdc-4d7d-ad92-5101c98b2d55 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:22.815088 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-33d7a95b-ccdc-4d7d-ad92-5101c98b2d55 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:22.823108 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-33d7a95b-ccdc-4d7d-ad92-5101c98b2d55 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1751 microversion: 2.1 time: 0.161588 May 26 14:03:22.823681 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 437/835] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:22 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:22.890868 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4250aa7c-41fc-4853-bed5-1d172cf7d450 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:22.891476 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4250aa7c-41fc-4853-bed5-1d172cf7d450 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 62e69036-90a3-4f5d-a79e-74bc3dc4467c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:22.897828 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4250aa7c-41fc-4853-bed5-1d172cf7d450 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:22.898271 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4250aa7c-41fc-4853-bed5-1d172cf7d450 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:22.899023 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4250aa7c-41fc-4853-bed5-1d172cf7d450 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:22.899452 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4250aa7c-41fc-4853-bed5-1d172cf7d450 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:23.031736 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4250aa7c-41fc-4853-bed5-1d172cf7d450 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:23.039657 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4250aa7c-41fc-4853-bed5-1d172cf7d450 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c" status: 200 len: 1317 microversion: 2.1 time: 0.153244 May 26 14:03:23.042247 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 399/836] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:22 2022] GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:23.449848 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e04f4e2b-0fa9-4188-9a7b-d8f3f940acb1 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:23.450453 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e04f4e2b-0fa9-4188-9a7b-d8f3f940acb1 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:23.456559 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e04f4e2b-0fa9-4188-9a7b-d8f3f940acb1 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:23.457010 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e04f4e2b-0fa9-4188-9a7b-d8f3f940acb1 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:23.457807 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e04f4e2b-0fa9-4188-9a7b-d8f3f940acb1 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:23.458241 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e04f4e2b-0fa9-4188-9a7b-d8f3f940acb1 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:23.591015 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e04f4e2b-0fa9-4188-9a7b-d8f3f940acb1 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:23.601125 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e04f4e2b-0fa9-4188-9a7b-d8f3f940acb1 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1683 microversion: 2.1 time: 0.155077 May 26 14:03:23.611577 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 438/837] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:23 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:23.839751 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-57106654-8e14-4364-a12d-719e55d63a4a tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:23.840576 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-57106654-8e14-4364-a12d-719e55d63a4a tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:23.850226 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57106654-8e14-4364-a12d-719e55d63a4a tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:23.850695 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57106654-8e14-4364-a12d-719e55d63a4a tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:23.851521 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57106654-8e14-4364-a12d-719e55d63a4a tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:23.851968 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57106654-8e14-4364-a12d-719e55d63a4a tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:23.995481 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-57106654-8e14-4364-a12d-719e55d63a4a tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:24.003332 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-57106654-8e14-4364-a12d-719e55d63a4a tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1756 microversion: 2.1 time: 0.167393 May 26 14:03:24.003901 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 400/838] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:23 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:24.055528 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-102cce24-1051-4b2f-87fe-562c8d6d0556 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:24.056142 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-102cce24-1051-4b2f-87fe-562c8d6d0556 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 62e69036-90a3-4f5d-a79e-74bc3dc4467c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:24.062798 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-102cce24-1051-4b2f-87fe-562c8d6d0556 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:24.063242 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-102cce24-1051-4b2f-87fe-562c8d6d0556 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:24.064083 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-102cce24-1051-4b2f-87fe-562c8d6d0556 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:24.064520 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-102cce24-1051-4b2f-87fe-562c8d6d0556 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:24.199026 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-102cce24-1051-4b2f-87fe-562c8d6d0556 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:24.206921 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-102cce24-1051-4b2f-87fe-562c8d6d0556 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c" status: 200 len: 1317 microversion: 2.1 time: 0.155252 May 26 14:03:24.207486 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 439/839] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:24 2022] GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:24.619093 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ff8371e6-58d1-470c-b2f5-5493093d7a82 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:24.619723 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ff8371e6-58d1-470c-b2f5-5493093d7a82 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:24.626334 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ff8371e6-58d1-470c-b2f5-5493093d7a82 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:24.626776 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ff8371e6-58d1-470c-b2f5-5493093d7a82 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:24.627543 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ff8371e6-58d1-470c-b2f5-5493093d7a82 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:24.627973 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ff8371e6-58d1-470c-b2f5-5493093d7a82 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:24.758040 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ff8371e6-58d1-470c-b2f5-5493093d7a82 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:24.766575 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ff8371e6-58d1-470c-b2f5-5493093d7a82 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1683 microversion: 2.1 time: 0.151159 May 26 14:03:24.777323 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 401/840] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:24 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:24.922799 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-87487074-737f-4760-8b50-65bb6e890d41 req-40259594-0cb9-4dc6-bd4d-249a8ebaa21e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e69036-90a3-4f5d-a79e-74bc3dc4467c", "name": "network-vif-plugged", "status": "completed", "tag": "3e9da444-5e7d-4d3e-974b-0f95030b725d"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:03:24.930992 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-87487074-737f-4760-8b50-65bb6e890d41 req-40259594-0cb9-4dc6-bd4d-249a8ebaa21e service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:24.931431 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-87487074-737f-4760-8b50-65bb6e890d41 req-40259594-0cb9-4dc6-bd4d-249a8ebaa21e service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:24.944674 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-87487074-737f-4760-8b50-65bb6e890d41 req-40259594-0cb9-4dc6-bd4d-249a8ebaa21e service nova] Creating event network-vif-plugged:3e9da444-5e7d-4d3e-974b-0f95030b725d for instance 62e69036-90a3-4f5d-a79e-74bc3dc4467c on hv-cinder-84213 May 26 14:03:24.949486 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-87487074-737f-4760-8b50-65bb6e890d41 req-40259594-0cb9-4dc6-bd4d-249a8ebaa21e service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031064 May 26 14:03:24.950507 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 440/841] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:03:25.021589 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d5b3f959-7479-43b6-8318-bdafa9f4729b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:25.022223 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d5b3f959-7479-43b6-8318-bdafa9f4729b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:25.028748 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d5b3f959-7479-43b6-8318-bdafa9f4729b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:25.030086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d5b3f959-7479-43b6-8318-bdafa9f4729b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:25.031102 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d5b3f959-7479-43b6-8318-bdafa9f4729b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:25.031769 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d5b3f959-7479-43b6-8318-bdafa9f4729b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:25.225818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-820ed718-5fe1-4f61-b83b-368456f1bc38 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:25.226353 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d5b3f959-7479-43b6-8318-bdafa9f4729b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:25.227492 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-820ed718-5fe1-4f61-b83b-368456f1bc38 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 62e69036-90a3-4f5d-a79e-74bc3dc4467c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:25.235708 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-820ed718-5fe1-4f61-b83b-368456f1bc38 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:25.236035 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d5b3f959-7479-43b6-8318-bdafa9f4729b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1756 microversion: 2.1 time: 0.218653 May 26 14:03:25.236387 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-820ed718-5fe1-4f61-b83b-368456f1bc38 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:25.236617 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 402/842] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:25 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1756 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:25.237386 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-820ed718-5fe1-4f61-b83b-368456f1bc38 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:25.237919 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-820ed718-5fe1-4f61-b83b-368456f1bc38 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:25.240816 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:25.383184 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-820ed718-5fe1-4f61-b83b-368456f1bc38 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:25.392769 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-820ed718-5fe1-4f61-b83b-368456f1bc38 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c" status: 200 len: 1317 microversion: 2.1 time: 0.172124 May 26 14:03:25.393648 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 441/843] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:25 2022] GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:25.439058 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-de34ba85-e1ad-41b3-a839-743f99758020 req-1f9beedc-0e0a-48f4-8bce-f86e9de696d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71af8283-a8f5-44e7-bdcd-6606070472b2", "name": "network-vif-deleted", "tag": "44b52c9b-2e5c-490a-ab42-cd30ca4bea28"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:03:25.447011 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-de34ba85-e1ad-41b3-a839-743f99758020 req-1f9beedc-0e0a-48f4-8bce-f86e9de696d7 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:25.447459 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-de34ba85-e1ad-41b3-a839-743f99758020 req-1f9beedc-0e0a-48f4-8bce-f86e9de696d7 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:25.459114 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-de34ba85-e1ad-41b3-a839-743f99758020 req-1f9beedc-0e0a-48f4-8bce-f86e9de696d7 service nova] Creating event network-vif-deleted:44b52c9b-2e5c-490a-ab42-cd30ca4bea28 for instance 71af8283-a8f5-44e7-bdcd-6606070472b2 on hv-cinder-84213 May 26 14:03:25.464014 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-de34ba85-e1ad-41b3-a839-743f99758020 req-1f9beedc-0e0a-48f4-8bce-f86e9de696d7 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028638 May 26 14:03:25.465007 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 403/844] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:03:25.785733 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f06678f4-c763-49cd-9bb1-8bd736f43add tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:25.786713 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f06678f4-c763-49cd-9bb1-8bd736f43add tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:25.793859 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f06678f4-c763-49cd-9bb1-8bd736f43add tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:25.794311 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f06678f4-c763-49cd-9bb1-8bd736f43add tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:25.795722 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f06678f4-c763-49cd-9bb1-8bd736f43add tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:25.796161 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f06678f4-c763-49cd-9bb1-8bd736f43add tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:25.876398 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f06678f4-c763-49cd-9bb1-8bd736f43add tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:25.884967 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f06678f4-c763-49cd-9bb1-8bd736f43add tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1615 microversion: 2.1 time: 0.104471 May 26 14:03:25.885748 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 442/845] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:25 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1615 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:26.257243 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c29905f6-ca6a-4ab0-a3fa-e4756b0db751 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:26.258012 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c29905f6-ca6a-4ab0-a3fa-e4756b0db751 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:26.265201 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c29905f6-ca6a-4ab0-a3fa-e4756b0db751 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:26.265700 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c29905f6-ca6a-4ab0-a3fa-e4756b0db751 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:26.266510 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c29905f6-ca6a-4ab0-a3fa-e4756b0db751 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:26.266946 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c29905f6-ca6a-4ab0-a3fa-e4756b0db751 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:26.288281 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:26.410795 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-59bcf963-93dc-46da-be51-4d14cd841ea7 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:26.411663 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-59bcf963-93dc-46da-be51-4d14cd841ea7 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 62e69036-90a3-4f5d-a79e-74bc3dc4467c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:26.418222 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-59bcf963-93dc-46da-be51-4d14cd841ea7 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:26.421670 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c29905f6-ca6a-4ab0-a3fa-e4756b0db751 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:26.425039 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-59bcf963-93dc-46da-be51-4d14cd841ea7 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:26.425918 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-59bcf963-93dc-46da-be51-4d14cd841ea7 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:26.426361 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-59bcf963-93dc-46da-be51-4d14cd841ea7 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:26.433604 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c29905f6-ca6a-4ab0-a3fa-e4756b0db751 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1756 microversion: 2.1 time: 0.183551 May 26 14:03:26.434218 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 404/846] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:26 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:26.580845 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-59bcf963-93dc-46da-be51-4d14cd841ea7 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:26.588672 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-59bcf963-93dc-46da-be51-4d14cd841ea7 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c" status: 200 len: 1317 microversion: 2.1 time: 0.181859 May 26 14:03:26.589361 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 443/847] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:26 2022] GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:03:26.902001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7c2f2ad7-0125-41a2-b6fe-dd4b1dd5cfba tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:26.902544 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7c2f2ad7-0125-41a2-b6fe-dd4b1dd5cfba tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:26.908511 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7c2f2ad7-0125-41a2-b6fe-dd4b1dd5cfba tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:26.908955 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7c2f2ad7-0125-41a2-b6fe-dd4b1dd5cfba tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:26.909749 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7c2f2ad7-0125-41a2-b6fe-dd4b1dd5cfba tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:26.910181 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7c2f2ad7-0125-41a2-b6fe-dd4b1dd5cfba tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:26.949433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7c2f2ad7-0125-41a2-b6fe-dd4b1dd5cfba tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:26.949892 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7c2f2ad7-0125-41a2-b6fe-dd4b1dd5cfba tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:26.950346 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-7c2f2ad7-0125-41a2-b6fe-dd4b1dd5cfba tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lazy-loading 'fault' on Instance uuid 71af8283-a8f5-44e7-bdcd-6606070472b2 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:03:26.990112 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7c2f2ad7-0125-41a2-b6fe-dd4b1dd5cfba tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:26.997605 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7c2f2ad7-0125-41a2-b6fe-dd4b1dd5cfba tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 200 len: 1331 microversion: 2.1 time: 0.099535 May 26 14:03:26.998820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 405/848] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:26 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:27.451318 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-473667e1-58c2-4398-a76c-100debff842d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:27.451951 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-473667e1-58c2-4398-a76c-100debff842d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:27.453939 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:27.454579 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=6 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:27.460613 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-473667e1-58c2-4398-a76c-100debff842d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:27.461070 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-473667e1-58c2-4398-a76c-100debff842d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:27.461859 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-473667e1-58c2-4398-a76c-100debff842d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:27.462292 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-473667e1-58c2-4398-a76c-100debff842d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:27.605709 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ba445f0e-d527-41ef-b382-cca8937f9aa8 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:27.606430 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ba445f0e-d527-41ef-b382-cca8937f9aa8 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 62e69036-90a3-4f5d-a79e-74bc3dc4467c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:27.608884 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:27.612709 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-473667e1-58c2-4398-a76c-100debff842d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:27.615228 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ba445f0e-d527-41ef-b382-cca8937f9aa8 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:27.615691 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ba445f0e-d527-41ef-b382-cca8937f9aa8 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:27.616470 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ba445f0e-d527-41ef-b382-cca8937f9aa8 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:27.616910 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ba445f0e-d527-41ef-b382-cca8937f9aa8 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:27.621056 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-473667e1-58c2-4398-a76c-100debff842d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1756 microversion: 2.1 time: 0.173531 May 26 14:03:27.621677 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 444/849] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:27 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:27.772562 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ba445f0e-d527-41ef-b382-cca8937f9aa8 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:27.780815 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ba445f0e-d527-41ef-b382-cca8937f9aa8 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c" status: 200 len: 1506 microversion: 2.1 time: 0.178946 May 26 14:03:27.781434 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 406/850] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:27 2022] GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:03:27.797233 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-824f7f43-34c8-4c54-b55e-8470562bd673 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cfc764c-15d7-4fcb-bb13-525c855a2441", "device": "/dev/sdb"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:03:27.798431 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-824f7f43-34c8-4c54-b55e-8470562bd673 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 62e69036-90a3-4f5d-a79e-74bc3dc4467c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:27.804517 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-824f7f43-34c8-4c54-b55e-8470562bd673 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:27.804945 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-824f7f43-34c8-4c54-b55e-8470562bd673 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:27.805735 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-824f7f43-34c8-4c54-b55e-8470562bd673 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:27.806170 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-824f7f43-34c8-4c54-b55e-8470562bd673 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:28.016231 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4ff923b3-b42b-440f-92ef-3f293bffe642 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:28.017449 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4ff923b3-b42b-440f-92ef-3f293bffe642 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:28.026679 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4ff923b3-b42b-440f-92ef-3f293bffe642 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:28.027309 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4ff923b3-b42b-440f-92ef-3f293bffe642 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:28.028606 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4ff923b3-b42b-440f-92ef-3f293bffe642 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:28.029832 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4ff923b3-b42b-440f-92ef-3f293bffe642 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:28.053268 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-4ff923b3-b42b-440f-92ef-3f293bffe642 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] HTTP exception thrown: Instance 71af8283-a8f5-44e7-bdcd-6606070472b2 could not be found. May 26 14:03:28.055096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4ff923b3-b42b-440f-92ef-3f293bffe642 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Request method failure captured: May 26 14:03:28.055096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 HTTP/1.1 May 26 14:03:28.055096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 14:03:28.055096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 14:03:28.055096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 14:03:28.055096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 14:03:28.055096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 14:03:28.055096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 14:03:28.055096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 14:03:28.055096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 14:03:28.055096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4b__678MF1xn-Y-FCgJA6efvs1BUPOjPQR7CX8Syda7vzr5d1CdCh5DI87op5BdIZCVD07V82_W1yg69L4heAf3g2lspOZA26PnKf-_EHlLlY2PFv6bdndxAuwButuA1UEOsadDnC15207Ae7Gdf_dlN6YFnL_d6Ys4jSw91hHf8Ro May 26 14:03:28.055096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 14:03:28.055096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 14:03:28.055096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 14:03:28.055096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 14:03:28.055096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 14:03:28.055096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 14:03:28.055096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:03:28.055096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:03:28.055096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 14:03:28.055096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 14:03:28.056551 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_af9d168c40ea4df99b495eb06245d066", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:03:28.056551 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:03:28.056551 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:03:28.056551 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:03:28.056551 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:03:28.056551 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 14:03:28.056551 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 14:03:28.056551 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: 592975b43454407abde6c7cab2504982 May 26 14:03:28.056551 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:03:28.056551 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: > May 26 14:03:28.056551 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Instance 71af8283-a8f5-44e7-bdcd-6606070472b2 could not be found. May 26 14:03:28.056551 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'id': '71af8283-a8f5-44e7-bdcd-6606070472b2'} May 26 14:03:28.057514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:03:28.057514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:03:28.057514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:03:28.057514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:03:28.057514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:03:28.057514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:03:28.057514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:03:28.057514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:03:28.057514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:03:28.057514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:03:28.057514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71af8283-a8f5-44e7-bdcd-6606070472b2 could not be found. May 26 14:03:28.057514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:03:28.057514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:03:28.057514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:03:28.057514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:03:28.057514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:03:28.057514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:03:28.057514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:03:28.057514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:03:28.057514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:03:28.059088 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:03:28.059088 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:03:28.059088 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:03:28.059088 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:03:28.059088 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:03:28.059088 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:03:28.059088 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:03:28.059088 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71af8283-a8f5-44e7-bdcd-6606070472b2 could not be found. May 26 14:03:28.059088 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:03:28.059088 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:03:28.059088 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:03:28.059088 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:03:28.059088 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:03:28.059088 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:03:28.059088 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:03:28.059088 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:03:28.059088 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71af8283-a8f5-44e7-bdcd-6606070472b2 could not be found. May 26 14:03:28.059088 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:03:28.060768 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4ff923b3-b42b-440f-92ef-3f293bffe642 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Returning 404 to user: Instance 71af8283-a8f5-44e7-bdcd-6606070472b2 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:03:28.060768 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4ff923b3-b42b-440f-92ef-3f293bffe642 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 404 len: 111 microversion: 2.1 time: 0.045206 May 26 14:03:28.060768 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 407/851] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:28 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:03:28.065451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cede4db5-6225-43cb-96f5-c7a35b483a33 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '.version_select at 0x7f25a4b88b80>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:28.072233 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:28.089295 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cede4db5-6225-43cb-96f5-c7a35b483a33 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112284842" status: 202 len: 0 microversion: 2.1 time: 0.027453 May 26 14:03:28.093193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 408/852] 10.222.0.91 () {58 vars in 1220 bytes} [Thu May 26 14:03:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112284842 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:03:28.100094 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-824f7f43-34c8-4c54-b55e-8470562bd673 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "POST /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307017 May 26 14:03:28.100710 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 445/853] 10.222.0.91 () {60 vars in 1322 bytes} [Thu May 26 14:03:27 2022] POST /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:03:28.638995 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-542ca1ec-bf6e-4555-8d5b-409735d8bbdd tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:28.639801 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-542ca1ec-bf6e-4555-8d5b-409735d8bbdd tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:28.646893 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-542ca1ec-bf6e-4555-8d5b-409735d8bbdd tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:28.647344 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-542ca1ec-bf6e-4555-8d5b-409735d8bbdd tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:28.648123 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-542ca1ec-bf6e-4555-8d5b-409735d8bbdd tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:28.648679 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-542ca1ec-bf6e-4555-8d5b-409735d8bbdd tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:28.804416 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-542ca1ec-bf6e-4555-8d5b-409735d8bbdd tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:28.813746 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-542ca1ec-bf6e-4555-8d5b-409735d8bbdd tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1756 microversion: 2.1 time: 0.179612 May 26 14:03:28.814330 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 409/854] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:28 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:29.008872 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6a18dfdc-8110-4c51-80db-7f4a6733603c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Action: 'create', calling method: .version_select at 0x7f25a498aaf0>, body: {"keypair": {"name": "tempest-keypair-1515242531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2Q+cKalxzj8i7p1UaMTqiNAwmnKliyBRiVLX5PFANcRp5smRrPu29bTGrzUMVFXWe1PzFgOJSBTvob4wQzNpL2m1125BGnx25jB8Drfd672KFjSklnfz06d3Pp9DoOgA=="}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:03:29.023345 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-6a18dfdc-8110-4c51-80db-7f4a6733603c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Getting quotas for project af9d168c40ea4df99b495eb06245d066. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 14:03:29.027309 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-6a18dfdc-8110-4c51-80db-7f4a6733603c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Getting quotas for user 592975b43454407abde6c7cab2504982 and project af9d168c40ea4df99b495eb06245d066. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 14:03:29.052590 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6a18dfdc-8110-4c51-80db-7f4a6733603c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048416 May 26 14:03:29.053208 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 446/855] 10.222.0.91 () {60 vars in 1158 bytes} [Thu May 26 14:03:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:03:29.830220 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a416d06f-2a61-46c1-ac8f-f0fa1ba4f87c tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:29.830769 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a416d06f-2a61-46c1-ac8f-f0fa1ba4f87c tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:29.837289 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a416d06f-2a61-46c1-ac8f-f0fa1ba4f87c tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:29.837745 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a416d06f-2a61-46c1-ac8f-f0fa1ba4f87c tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:29.838531 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a416d06f-2a61-46c1-ac8f-f0fa1ba4f87c tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:29.839003 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a416d06f-2a61-46c1-ac8f-f0fa1ba4f87c tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:29.985255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a416d06f-2a61-46c1-ac8f-f0fa1ba4f87c tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:29.993173 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a416d06f-2a61-46c1-ac8f-f0fa1ba4f87c tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1756 microversion: 2.1 time: 0.167062 May 26 14:03:29.993779 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 410/856] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:29 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:30.301797 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4ab9eb0c-072f-4bc5-b12e-8a5a501b8e45 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-210645591", "imageRef": "bcaacfae-fe2c-455f-a6e1-b08361c6fa8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f7e5c2e-dcd0-44c0-a251-a7bcffefb292"}], "security_groups": [{"name": "tempest-securitygroup--1710277154"}], "key_name": "tempest-keypair-1515242531", "user_data": "}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:03:30.399542 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-4ab9eb0c-072f-4bc5-b12e-8a5a501b8e45 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] validate_networks() for [('5f7e5c2e-dcd0-44c0-a251-a7bcffefb292', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 14:03:30.756142 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-4ab9eb0c-072f-4bc5-b12e-8a5a501b8e45 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 14:03:30.756569 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-4ab9eb0c-072f-4bc5-b12e-8a5a501b8e45 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 14:03:30.757045 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-4ab9eb0c-072f-4bc5-b12e-8a5a501b8e45 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 14:03:30.757503 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-4ab9eb0c-072f-4bc5-b12e-8a5a501b8e45 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 14:03:30.757914 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-4ab9eb0c-072f-4bc5-b12e-8a5a501b8e45 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 14:03:30.767574 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4ab9eb0c-072f-4bc5-b12e-8a5a501b8e45 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:30.768026 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4ab9eb0c-072f-4bc5-b12e-8a5a501b8e45 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:30.769084 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4ab9eb0c-072f-4bc5-b12e-8a5a501b8e45 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:30.769550 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4ab9eb0c-072f-4bc5-b12e-8a5a501b8e45 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:30.786381 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-4ab9eb0c-072f-4bc5-b12e-8a5a501b8e45 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Getting quotas for project af9d168c40ea4df99b495eb06245d066. Resources: {'ram', 'cores', 'instances'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 14:03:30.790320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-4ab9eb0c-072f-4bc5-b12e-8a5a501b8e45 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Getting quotas for user 592975b43454407abde6c7cab2504982 and project af9d168c40ea4df99b495eb06245d066. Resources: {'ram', 'cores', 'instances'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 14:03:30.802297 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4ab9eb0c-072f-4bc5-b12e-8a5a501b8e45 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 14:03:30.804686 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4ab9eb0c-072f-4bc5-b12e-8a5a501b8e45 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bcaacfae-fe2c-455f-a6e1-b08361c6fa8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 14:03:30.855797 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4ab9eb0c-072f-4bc5-b12e-8a5a501b8e45 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.558707 May 26 14:03:30.856443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 447/857] 10.222.0.91 () {60 vars in 1146 bytes} [Thu May 26 14:03:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 14:03:30.866549 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d987a3d3-8358-453f-9de1-ede72b71ae75 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:30.867169 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d987a3d3-8358-453f-9de1-ede72b71ae75 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:30.921039 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d987a3d3-8358-453f-9de1-ede72b71ae75 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:30.927752 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d987a3d3-8358-453f-9de1-ede72b71ae75 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 200 len: 1241 microversion: 2.1 time: 0.065252 May 26 14:03:30.928351 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 411/858] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:30 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:31.011526 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e0d9e16f-70ea-4be0-92aa-7acf0beee5cc tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:31.012426 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e0d9e16f-70ea-4be0-92aa-7acf0beee5cc tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:31.020138 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e0d9e16f-70ea-4be0-92aa-7acf0beee5cc tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:31.020590 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e0d9e16f-70ea-4be0-92aa-7acf0beee5cc tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:31.021397 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e0d9e16f-70ea-4be0-92aa-7acf0beee5cc tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:31.021964 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e0d9e16f-70ea-4be0-92aa-7acf0beee5cc tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:31.200135 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e0d9e16f-70ea-4be0-92aa-7acf0beee5cc tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:31.215564 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e0d9e16f-70ea-4be0-92aa-7acf0beee5cc tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1756 microversion: 2.1 time: 0.207925 May 26 14:03:31.216624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 448/859] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:31 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1756 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:31.943831 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-60a388a0-4c9c-4779-9076-8a02357b383b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:31.944564 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-60a388a0-4c9c-4779-9076-8a02357b383b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:31.952527 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-60a388a0-4c9c-4779-9076-8a02357b383b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:31.952976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-60a388a0-4c9c-4779-9076-8a02357b383b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:31.953822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-60a388a0-4c9c-4779-9076-8a02357b383b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:31.954262 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-60a388a0-4c9c-4779-9076-8a02357b383b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:32.023461 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-60a388a0-4c9c-4779-9076-8a02357b383b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:32.032380 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-60a388a0-4c9c-4779-9076-8a02357b383b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 200 len: 1293 microversion: 2.1 time: 0.092335 May 26 14:03:32.032967 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 412/860] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:31 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:32.239786 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-42c521c1-3d4e-429a-b961-bc84fd725567 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:32.240475 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-42c521c1-3d4e-429a-b961-bc84fd725567 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:32.249401 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-42c521c1-3d4e-429a-b961-bc84fd725567 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:32.250160 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-42c521c1-3d4e-429a-b961-bc84fd725567 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:32.251136 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-42c521c1-3d4e-429a-b961-bc84fd725567 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:32.251711 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-42c521c1-3d4e-429a-b961-bc84fd725567 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:32.411374 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-42c521c1-3d4e-429a-b961-bc84fd725567 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:32.420447 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-42c521c1-3d4e-429a-b961-bc84fd725567 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1756 microversion: 2.1 time: 0.185260 May 26 14:03:32.421042 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 449/861] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:32 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:33.052024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-54f1acd6-abc4-4053-9f11-514f03a17137 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:33.052642 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-54f1acd6-abc4-4053-9f11-514f03a17137 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:33.058893 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-54f1acd6-abc4-4053-9f11-514f03a17137 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:33.059347 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-54f1acd6-abc4-4053-9f11-514f03a17137 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:33.060118 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-54f1acd6-abc4-4053-9f11-514f03a17137 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:33.061817 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-54f1acd6-abc4-4053-9f11-514f03a17137 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:33.197973 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-54f1acd6-abc4-4053-9f11-514f03a17137 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:33.205903 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-54f1acd6-abc4-4053-9f11-514f03a17137 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 200 len: 1367 microversion: 2.1 time: 0.157904 May 26 14:03:33.206467 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 413/862] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:33 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:33.437881 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8a563ef9-6118-4b60-9d42-7d58ddaeb8f7 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:33.439119 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8a563ef9-6118-4b60-9d42-7d58ddaeb8f7 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:33.450075 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8a563ef9-6118-4b60-9d42-7d58ddaeb8f7 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:33.451066 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8a563ef9-6118-4b60-9d42-7d58ddaeb8f7 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:33.451303 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8a563ef9-6118-4b60-9d42-7d58ddaeb8f7 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:33.451745 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8a563ef9-6118-4b60-9d42-7d58ddaeb8f7 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:33.606997 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-5815ab18-a28e-49ba-9631-c0674bdee719 req-ac1c0247-6f45-4076-8593-f2be9dd4a40f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6c7fc24-24aa-48ea-b184-38585d2ffb40", "tag": "36211193-9c2e-4666-9039-2f26d4b7c02d"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:03:33.622075 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-5815ab18-a28e-49ba-9631-c0674bdee719 req-ac1c0247-6f45-4076-8593-f2be9dd4a40f service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:33.622422 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-5815ab18-a28e-49ba-9631-c0674bdee719 req-ac1c0247-6f45-4076-8593-f2be9dd4a40f service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:33.624066 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8a563ef9-6118-4b60-9d42-7d58ddaeb8f7 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:33.636796 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8a563ef9-6118-4b60-9d42-7d58ddaeb8f7 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1756 microversion: 2.1 time: 0.202835 May 26 14:03:33.637617 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 450/863] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:33 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1756 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:33.648577 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-5815ab18-a28e-49ba-9631-c0674bdee719 req-ac1c0247-6f45-4076-8593-f2be9dd4a40f service nova] Creating event network-changed:36211193-9c2e-4666-9039-2f26d4b7c02d for instance d6c7fc24-24aa-48ea-b184-38585d2ffb40 on hv-cinder-84213 May 26 14:03:33.650110 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-5815ab18-a28e-49ba-9631-c0674bdee719 req-ac1c0247-6f45-4076-8593-f2be9dd4a40f service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046682 May 26 14:03:33.650816 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 414/864] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:03:34.223121 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2a7600ab-6562-45a8-82a9-d22988f7c417 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:34.223739 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2a7600ab-6562-45a8-82a9-d22988f7c417 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:34.230086 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2a7600ab-6562-45a8-82a9-d22988f7c417 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:34.230443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2a7600ab-6562-45a8-82a9-d22988f7c417 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:34.231216 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2a7600ab-6562-45a8-82a9-d22988f7c417 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:34.231651 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2a7600ab-6562-45a8-82a9-d22988f7c417 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:34.367248 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2a7600ab-6562-45a8-82a9-d22988f7c417 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:34.375229 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2a7600ab-6562-45a8-82a9-d22988f7c417 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 200 len: 1367 microversion: 2.1 time: 0.156078 May 26 14:03:34.375808 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 451/865] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:34 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:34.656369 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2ce85924-2790-43be-b973-32e1751646ef tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:34.660759 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2ce85924-2790-43be-b973-32e1751646ef tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:34.664425 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ce85924-2790-43be-b973-32e1751646ef tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:34.664879 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ce85924-2790-43be-b973-32e1751646ef tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:34.666069 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ce85924-2790-43be-b973-32e1751646ef tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:34.666583 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ce85924-2790-43be-b973-32e1751646ef tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:34.810560 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2ce85924-2790-43be-b973-32e1751646ef tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:34.818486 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2ce85924-2790-43be-b973-32e1751646ef tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1756 microversion: 2.1 time: 0.166991 May 26 14:03:34.819053 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 415/866] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:34 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:35.391928 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2b818113-4fbb-4c4c-a4d8-ad1c8af0025a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:35.393358 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2b818113-4fbb-4c4c-a4d8-ad1c8af0025a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:35.399840 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2b818113-4fbb-4c4c-a4d8-ad1c8af0025a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:35.400291 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2b818113-4fbb-4c4c-a4d8-ad1c8af0025a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:35.401054 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2b818113-4fbb-4c4c-a4d8-ad1c8af0025a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:35.401516 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2b818113-4fbb-4c4c-a4d8-ad1c8af0025a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:35.533092 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2b818113-4fbb-4c4c-a4d8-ad1c8af0025a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:35.541322 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2b818113-4fbb-4c4c-a4d8-ad1c8af0025a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 200 len: 1367 microversion: 2.1 time: 0.153280 May 26 14:03:35.542121 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 452/867] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:35 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:35.835399 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cb07e875-ccd0-4a09-8e27-f53fee9c402e tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:35.836013 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cb07e875-ccd0-4a09-8e27-f53fee9c402e tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:35.842513 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cb07e875-ccd0-4a09-8e27-f53fee9c402e tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:35.842969 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cb07e875-ccd0-4a09-8e27-f53fee9c402e tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:35.843734 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cb07e875-ccd0-4a09-8e27-f53fee9c402e tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:35.844169 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cb07e875-ccd0-4a09-8e27-f53fee9c402e tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:35.999765 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cb07e875-ccd0-4a09-8e27-f53fee9c402e tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:36.008010 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cb07e875-ccd0-4a09-8e27-f53fee9c402e tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1759 microversion: 2.1 time: 0.176393 May 26 14:03:36.012973 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 416/868] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:35 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1759 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:03:36.559019 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4104819b-f423-4330-b30b-d20c5fa0bbad tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:36.559642 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4104819b-f423-4330-b30b-d20c5fa0bbad tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:36.566164 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4104819b-f423-4330-b30b-d20c5fa0bbad tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:36.566616 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4104819b-f423-4330-b30b-d20c5fa0bbad tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:36.567410 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4104819b-f423-4330-b30b-d20c5fa0bbad tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:36.567849 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4104819b-f423-4330-b30b-d20c5fa0bbad tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:36.707812 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4104819b-f423-4330-b30b-d20c5fa0bbad tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:36.718820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4104819b-f423-4330-b30b-d20c5fa0bbad tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 200 len: 1367 microversion: 2.1 time: 0.163582 May 26 14:03:36.719413 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 453/869] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:36 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:37.735710 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6a5a7b86-352a-4d5d-b32a-84d68a99a9f0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:37.736323 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6a5a7b86-352a-4d5d-b32a-84d68a99a9f0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:37.742791 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6a5a7b86-352a-4d5d-b32a-84d68a99a9f0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:37.743239 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6a5a7b86-352a-4d5d-b32a-84d68a99a9f0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:37.744023 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6a5a7b86-352a-4d5d-b32a-84d68a99a9f0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:37.744454 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6a5a7b86-352a-4d5d-b32a-84d68a99a9f0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:37.874964 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6a5a7b86-352a-4d5d-b32a-84d68a99a9f0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:37.882390 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6a5a7b86-352a-4d5d-b32a-84d68a99a9f0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 200 len: 1367 microversion: 2.1 time: 0.150548 May 26 14:03:37.882964 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 417/870] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:37 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:38.899913 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-435a97f4-4fc3-4ce5-bb62-244a7db8c77d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:38.900499 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-435a97f4-4fc3-4ce5-bb62-244a7db8c77d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:38.907165 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-435a97f4-4fc3-4ce5-bb62-244a7db8c77d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:38.907609 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-435a97f4-4fc3-4ce5-bb62-244a7db8c77d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:38.908380 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-435a97f4-4fc3-4ce5-bb62-244a7db8c77d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:38.908812 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-435a97f4-4fc3-4ce5-bb62-244a7db8c77d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:39.047235 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-435a97f4-4fc3-4ce5-bb62-244a7db8c77d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:39.054760 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-435a97f4-4fc3-4ce5-bb62-244a7db8c77d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 200 len: 1367 microversion: 2.1 time: 0.158791 May 26 14:03:39.055343 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 454/871] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:38 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:40.071616 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d2a6f44d-6151-4f95-8132-63d4839ef60d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:40.072227 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d2a6f44d-6151-4f95-8132-63d4839ef60d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:40.079440 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d2a6f44d-6151-4f95-8132-63d4839ef60d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:40.079893 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d2a6f44d-6151-4f95-8132-63d4839ef60d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:40.080652 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d2a6f44d-6151-4f95-8132-63d4839ef60d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:40.081094 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d2a6f44d-6151-4f95-8132-63d4839ef60d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:40.213330 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d2a6f44d-6151-4f95-8132-63d4839ef60d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:40.221682 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d2a6f44d-6151-4f95-8132-63d4839ef60d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 200 len: 1367 microversion: 2.1 time: 0.153580 May 26 14:03:40.222250 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 418/872] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:40 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:41.239056 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-28e18926-9d83-4ec4-94e6-9615d3a5d329 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:41.239678 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-28e18926-9d83-4ec4-94e6-9615d3a5d329 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:41.242142 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:41.242793 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=10 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:41.249045 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28e18926-9d83-4ec4-94e6-9615d3a5d329 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:41.249514 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28e18926-9d83-4ec4-94e6-9615d3a5d329 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:41.250287 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28e18926-9d83-4ec4-94e6-9615d3a5d329 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:41.250719 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28e18926-9d83-4ec4-94e6-9615d3a5d329 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:41.380919 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-28e18926-9d83-4ec4-94e6-9615d3a5d329 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:41.388218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-28e18926-9d83-4ec4-94e6-9615d3a5d329 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 200 len: 1367 microversion: 2.1 time: 0.153025 May 26 14:03:41.388788 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 455/873] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:41 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:42.404721 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f3757946-2960-4d55-a741-7e734b4f8217 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:42.405362 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f3757946-2960-4d55-a741-7e734b4f8217 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:42.407448 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:42.413328 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f3757946-2960-4d55-a741-7e734b4f8217 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:42.413785 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f3757946-2960-4d55-a741-7e734b4f8217 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:42.414547 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f3757946-2960-4d55-a741-7e734b4f8217 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:42.414990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f3757946-2960-4d55-a741-7e734b4f8217 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:42.541415 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f3757946-2960-4d55-a741-7e734b4f8217 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:42.549881 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f3757946-2960-4d55-a741-7e734b4f8217 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 200 len: 1367 microversion: 2.1 time: 0.149035 May 26 14:03:42.550456 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 419/874] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:42 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:43.054625 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2726aceb-3a5a-4b08-871f-ef669c9d67bd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:43.055109 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2726aceb-3a5a-4b08-871f-ef669c9d67bd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:43.062041 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2726aceb-3a5a-4b08-871f-ef669c9d67bd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:43.062489 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2726aceb-3a5a-4b08-871f-ef669c9d67bd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:43.063266 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2726aceb-3a5a-4b08-871f-ef669c9d67bd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:43.063705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2726aceb-3a5a-4b08-871f-ef669c9d67bd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:43.095095 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2726aceb-3a5a-4b08-871f-ef669c9d67bd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/os-volume_attachments/73c6de89-2c31-4db8-a60b-be5650ecc312" status: 200 len: 194 microversion: 2.20 time: 0.044835 May 26 14:03:43.095486 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 456/875] 10.222.0.91 () {60 vars in 1453 bytes} [Thu May 26 14:03:43 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/os-volume_attachments/73c6de89-2c31-4db8-a60b-be5650ecc312 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:03:43.176943 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-eb7d9ca2-0bd1-4e85-8f7c-f94b63405da6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:43.177471 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-eb7d9ca2-0bd1-4e85-8f7c-f94b63405da6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:43.183891 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eb7d9ca2-0bd1-4e85-8f7c-f94b63405da6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:43.184343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eb7d9ca2-0bd1-4e85-8f7c-f94b63405da6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:43.185114 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eb7d9ca2-0bd1-4e85-8f7c-f94b63405da6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:43.185576 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eb7d9ca2-0bd1-4e85-8f7c-f94b63405da6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:43.265767 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-eb7d9ca2-0bd1-4e85-8f7c-f94b63405da6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lazy-loading 'services' on Instance uuid 9116ee60-50e6-48c5-bcc1-8e9d08e35458 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:03:43.366444 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-eb7d9ca2-0bd1-4e85-8f7c-f94b63405da6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "DELETE /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/os-volume_attachments/73c6de89-2c31-4db8-a60b-be5650ecc312" status: 202 len: 0 microversion: 2.20 time: 0.193419 May 26 14:03:43.367031 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 420/876] 10.222.0.91 () {60 vars in 1456 bytes} [Thu May 26 14:03:43 2022] DELETE /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/os-volume_attachments/73c6de89-2c31-4db8-a60b-be5650ecc312 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 14:03:43.376033 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-bd3779ff-c4ab-4b82-ac0b-f6f907c0e572 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:43.377010 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-bd3779ff-c4ab-4b82-ac0b-f6f907c0e572 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:43.383140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bd3779ff-c4ab-4b82-ac0b-f6f907c0e572 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:43.383588 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bd3779ff-c4ab-4b82-ac0b-f6f907c0e572 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:43.384352 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bd3779ff-c4ab-4b82-ac0b-f6f907c0e572 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:43.384797 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bd3779ff-c4ab-4b82-ac0b-f6f907c0e572 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:43.413849 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-bd3779ff-c4ab-4b82-ac0b-f6f907c0e572 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042401 May 26 14:03:43.414402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 457/877] 10.222.0.91 () {60 vars in 1342 bytes} [Thu May 26 14:03:43 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:03:43.567278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2602e579-c479-423d-8ff8-2691ea856a8c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:43.567879 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2602e579-c479-423d-8ff8-2691ea856a8c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:43.575293 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2602e579-c479-423d-8ff8-2691ea856a8c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:43.575718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2602e579-c479-423d-8ff8-2691ea856a8c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:43.576486 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2602e579-c479-423d-8ff8-2691ea856a8c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:43.577542 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2602e579-c479-423d-8ff8-2691ea856a8c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:43.723511 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2602e579-c479-423d-8ff8-2691ea856a8c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:43.733687 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2602e579-c479-423d-8ff8-2691ea856a8c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 200 len: 1367 microversion: 2.1 time: 0.170207 May 26 14:03:43.734265 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 421/878] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:43 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:44.425829 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-34927f79-df85-4e40-b3c1-a797e629aa9d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:44.426662 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-34927f79-df85-4e40-b3c1-a797e629aa9d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:44.433167 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-34927f79-df85-4e40-b3c1-a797e629aa9d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:44.433622 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-34927f79-df85-4e40-b3c1-a797e629aa9d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:44.434381 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-34927f79-df85-4e40-b3c1-a797e629aa9d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:44.434818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-34927f79-df85-4e40-b3c1-a797e629aa9d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:44.439186 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:44.466557 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-34927f79-df85-4e40-b3c1-a797e629aa9d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044766 May 26 14:03:44.467120 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 458/879] 10.222.0.91 () {60 vars in 1342 bytes} [Thu May 26 14:03:44 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:03:44.751280 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e9b6e37c-d89c-4a4a-b090-b9968fc4da5f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:44.751892 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e9b6e37c-d89c-4a4a-b090-b9968fc4da5f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:44.757932 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e9b6e37c-d89c-4a4a-b090-b9968fc4da5f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:44.758382 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e9b6e37c-d89c-4a4a-b090-b9968fc4da5f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:44.759141 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e9b6e37c-d89c-4a4a-b090-b9968fc4da5f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:44.759580 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e9b6e37c-d89c-4a4a-b090-b9968fc4da5f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:44.884278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e9b6e37c-d89c-4a4a-b090-b9968fc4da5f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:44.891671 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e9b6e37c-d89c-4a4a-b090-b9968fc4da5f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 200 len: 1367 microversion: 2.1 time: 0.145096 May 26 14:03:44.892235 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 422/880] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:44 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:45.478651 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-10dbf544-7139-4e0f-aa68-cd2c39a3609d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:45.479621 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-10dbf544-7139-4e0f-aa68-cd2c39a3609d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:45.486223 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-10dbf544-7139-4e0f-aa68-cd2c39a3609d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:45.486673 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-10dbf544-7139-4e0f-aa68-cd2c39a3609d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:45.487433 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-10dbf544-7139-4e0f-aa68-cd2c39a3609d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:45.487866 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-10dbf544-7139-4e0f-aa68-cd2c39a3609d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:45.517389 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-10dbf544-7139-4e0f-aa68-cd2c39a3609d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042766 May 26 14:03:45.518205 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 459/881] 10.222.0.91 () {60 vars in 1342 bytes} [Thu May 26 14:03:45 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:03:45.908911 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dbc2f528-b612-4b54-8c60-43579f1ac2fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:45.909492 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-dbc2f528-b612-4b54-8c60-43579f1ac2fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:45.915940 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dbc2f528-b612-4b54-8c60-43579f1ac2fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:45.916395 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dbc2f528-b612-4b54-8c60-43579f1ac2fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:45.917180 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dbc2f528-b612-4b54-8c60-43579f1ac2fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:45.917631 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dbc2f528-b612-4b54-8c60-43579f1ac2fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:45.935928 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:46.058526 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dbc2f528-b612-4b54-8c60-43579f1ac2fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:46.066953 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dbc2f528-b612-4b54-8c60-43579f1ac2fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 200 len: 1367 microversion: 2.1 time: 0.161698 May 26 14:03:46.067957 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 423/882] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:45 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:46.529514 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-44baa19f-5899-47d3-83b8-8e43fb21dada tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:46.530926 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-44baa19f-5899-47d3-83b8-8e43fb21dada tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:46.537453 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-44baa19f-5899-47d3-83b8-8e43fb21dada tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:46.537906 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-44baa19f-5899-47d3-83b8-8e43fb21dada tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:46.538703 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-44baa19f-5899-47d3-83b8-8e43fb21dada tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:46.539144 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-44baa19f-5899-47d3-83b8-8e43fb21dada tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:46.567783 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-44baa19f-5899-47d3-83b8-8e43fb21dada tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042329 May 26 14:03:46.568344 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 460/883] 10.222.0.91 () {60 vars in 1342 bytes} [Thu May 26 14:03:46 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:03:47.083955 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-19af63f5-97c8-476d-87ef-b094fe932d83 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:47.084622 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-19af63f5-97c8-476d-87ef-b094fe932d83 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:47.091113 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-19af63f5-97c8-476d-87ef-b094fe932d83 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:47.091563 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-19af63f5-97c8-476d-87ef-b094fe932d83 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:47.092340 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-19af63f5-97c8-476d-87ef-b094fe932d83 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:47.093405 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-19af63f5-97c8-476d-87ef-b094fe932d83 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:47.220272 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-19af63f5-97c8-476d-87ef-b094fe932d83 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:47.227616 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-19af63f5-97c8-476d-87ef-b094fe932d83 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 200 len: 1367 microversion: 2.1 time: 0.147731 May 26 14:03:47.228175 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 424/884] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:47 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:47.579731 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ca126e6c-b73f-4aa2-843e-051ad9aa27cd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:47.580686 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ca126e6c-b73f-4aa2-843e-051ad9aa27cd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:47.587151 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ca126e6c-b73f-4aa2-843e-051ad9aa27cd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:47.587602 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ca126e6c-b73f-4aa2-843e-051ad9aa27cd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:47.588364 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ca126e6c-b73f-4aa2-843e-051ad9aa27cd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:47.588804 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ca126e6c-b73f-4aa2-843e-051ad9aa27cd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:47.617627 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ca126e6c-b73f-4aa2-843e-051ad9aa27cd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041958 May 26 14:03:47.618186 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 461/885] 10.222.0.91 () {60 vars in 1342 bytes} [Thu May 26 14:03:47 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 14:03:48.243937 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4cce3b93-b4f6-4b4d-a0fd-367e1b51cb15 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:48.244555 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4cce3b93-b4f6-4b4d-a0fd-367e1b51cb15 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:48.251123 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4cce3b93-b4f6-4b4d-a0fd-367e1b51cb15 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:48.251582 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4cce3b93-b4f6-4b4d-a0fd-367e1b51cb15 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:48.252517 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4cce3b93-b4f6-4b4d-a0fd-367e1b51cb15 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:48.252961 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4cce3b93-b4f6-4b4d-a0fd-367e1b51cb15 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:48.388603 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4cce3b93-b4f6-4b4d-a0fd-367e1b51cb15 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:48.397502 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4cce3b93-b4f6-4b4d-a0fd-367e1b51cb15 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 200 len: 1367 microversion: 2.1 time: 0.157306 May 26 14:03:48.398059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 425/886] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:48 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:48.632681 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1ffa3e43-22e1-4831-ac2b-a3fea0e2b70e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:48.633659 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1ffa3e43-22e1-4831-ac2b-a3fea0e2b70e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:48.640965 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1ffa3e43-22e1-4831-ac2b-a3fea0e2b70e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:48.641558 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1ffa3e43-22e1-4831-ac2b-a3fea0e2b70e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:48.642598 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1ffa3e43-22e1-4831-ac2b-a3fea0e2b70e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:48.643375 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1ffa3e43-22e1-4831-ac2b-a3fea0e2b70e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:48.678575 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1ffa3e43-22e1-4831-ac2b-a3fea0e2b70e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051086 May 26 14:03:48.679157 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 462/887] 10.222.0.91 () {60 vars in 1342 bytes} [Thu May 26 14:03:48 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:03:49.414362 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d8adb4f1-c3ca-4bc6-9aab-bab3809e041f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:49.414972 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d8adb4f1-c3ca-4bc6-9aab-bab3809e041f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:49.422090 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d8adb4f1-c3ca-4bc6-9aab-bab3809e041f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:49.422543 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d8adb4f1-c3ca-4bc6-9aab-bab3809e041f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:49.423413 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d8adb4f1-c3ca-4bc6-9aab-bab3809e041f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:49.423734 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d8adb4f1-c3ca-4bc6-9aab-bab3809e041f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:49.558817 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d8adb4f1-c3ca-4bc6-9aab-bab3809e041f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:49.566411 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d8adb4f1-c3ca-4bc6-9aab-bab3809e041f tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 200 len: 1367 microversion: 2.1 time: 0.156071 May 26 14:03:49.566965 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 426/888] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:49 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:49.690293 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c7355ec0-ac2b-4438-8370-4ffff9adb9de tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:49.691206 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c7355ec0-ac2b-4438-8370-4ffff9adb9de tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:49.697710 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c7355ec0-ac2b-4438-8370-4ffff9adb9de tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:49.698152 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c7355ec0-ac2b-4438-8370-4ffff9adb9de tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:49.698904 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c7355ec0-ac2b-4438-8370-4ffff9adb9de tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:49.699333 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c7355ec0-ac2b-4438-8370-4ffff9adb9de tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:49.728266 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c7355ec0-ac2b-4438-8370-4ffff9adb9de tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041928 May 26 14:03:49.728741 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 463/889] 10.222.0.91 () {60 vars in 1342 bytes} [Thu May 26 14:03:49 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:49.790136 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a01e5d1f-ea9f-48f6-a91f-82e3a10b63f2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:49.790642 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a01e5d1f-ea9f-48f6-a91f-82e3a10b63f2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:49.796558 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a01e5d1f-ea9f-48f6-a91f-82e3a10b63f2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:49.797008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a01e5d1f-ea9f-48f6-a91f-82e3a10b63f2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:49.797814 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a01e5d1f-ea9f-48f6-a91f-82e3a10b63f2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:49.798256 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a01e5d1f-ea9f-48f6-a91f-82e3a10b63f2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:49.824426 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a01e5d1f-ea9f-48f6-a91f-82e3a10b63f2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 14:03:49.900762 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-baa2f185-7917-40ad-9948-cd3881bd56ba req-5eab6f2a-ee0e-4085-947b-5c334c971f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c7fc24-24aa-48ea-b184-38585d2ffb40", "name": "network-vif-plugged", "status": "completed", "tag": "36211193-9c2e-4666-9039-2f26d4b7c02d"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:03:49.904626 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a01e5d1f-ea9f-48f6-a91f-82e3a10b63f2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "DELETE /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 204 len: 0 microversion: 2.20 time: 0.118091 May 26 14:03:49.909241 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 427/890] 10.222.0.91 () {60 vars in 1279 bytes} [Thu May 26 14:03:49 2022] DELETE /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 14:03:49.915036 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-850eb6e4-3b6d-4132-a4cf-fb5bbf6fd1fb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:49.915747 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-850eb6e4-3b6d-4132-a4cf-fb5bbf6fd1fb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:49.920432 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-baa2f185-7917-40ad-9948-cd3881bd56ba req-5eab6f2a-ee0e-4085-947b-5c334c971f5a service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:49.921116 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-baa2f185-7917-40ad-9948-cd3881bd56ba req-5eab6f2a-ee0e-4085-947b-5c334c971f5a service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:49.921992 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-850eb6e4-3b6d-4132-a4cf-fb5bbf6fd1fb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:49.922450 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-850eb6e4-3b6d-4132-a4cf-fb5bbf6fd1fb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:49.923231 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-850eb6e4-3b6d-4132-a4cf-fb5bbf6fd1fb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:49.923673 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-850eb6e4-3b6d-4132-a4cf-fb5bbf6fd1fb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:49.934887 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-baa2f185-7917-40ad-9948-cd3881bd56ba req-5eab6f2a-ee0e-4085-947b-5c334c971f5a service nova] Creating event network-vif-plugged:36211193-9c2e-4666-9039-2f26d4b7c02d for instance d6c7fc24-24aa-48ea-b184-38585d2ffb40 on hv-cinder-84213 May 26 14:03:49.942092 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-baa2f185-7917-40ad-9948-cd3881bd56ba req-5eab6f2a-ee0e-4085-947b-5c334c971f5a service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047956 May 26 14:03:49.942904 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 464/891] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:03:50.057628 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-850eb6e4-3b6d-4132-a4cf-fb5bbf6fd1fb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:50.065792 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-850eb6e4-3b6d-4132-a4cf-fb5bbf6fd1fb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:50.067308 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-850eb6e4-3b6d-4132-a4cf-fb5bbf6fd1fb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:50.068478 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-850eb6e4-3b6d-4132-a4cf-fb5bbf6fd1fb tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1724 microversion: 2.20 time: 0.158041 May 26 14:03:50.069032 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 428/892] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:03:49 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:03:50.583807 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-25528232-e5b2-40bf-87e3-dc39ff753b2d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:50.584649 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-25528232-e5b2-40bf-87e3-dc39ff753b2d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:50.586703 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:50.592755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-25528232-e5b2-40bf-87e3-dc39ff753b2d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:50.593236 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-25528232-e5b2-40bf-87e3-dc39ff753b2d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:50.594020 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-25528232-e5b2-40bf-87e3-dc39ff753b2d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:50.594456 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-25528232-e5b2-40bf-87e3-dc39ff753b2d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:50.725885 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-25528232-e5b2-40bf-87e3-dc39ff753b2d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:50.733854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-25528232-e5b2-40bf-87e3-dc39ff753b2d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 200 len: 1367 microversion: 2.1 time: 0.154423 May 26 14:03:50.734426 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 465/893] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:50 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:03:51.088135 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3d76f6a7-83ea-4e64-b7ba-61898aae2dc7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:51.089043 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3d76f6a7-83ea-4e64-b7ba-61898aae2dc7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:51.096052 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3d76f6a7-83ea-4e64-b7ba-61898aae2dc7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:51.096492 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3d76f6a7-83ea-4e64-b7ba-61898aae2dc7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:51.097284 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3d76f6a7-83ea-4e64-b7ba-61898aae2dc7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:51.098155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3d76f6a7-83ea-4e64-b7ba-61898aae2dc7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:51.228678 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3d76f6a7-83ea-4e64-b7ba-61898aae2dc7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:51.236838 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3d76f6a7-83ea-4e64-b7ba-61898aae2dc7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:51.238449 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3d76f6a7-83ea-4e64-b7ba-61898aae2dc7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:51.239605 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3d76f6a7-83ea-4e64-b7ba-61898aae2dc7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1724 microversion: 2.20 time: 0.155718 May 26 14:03:51.240164 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 429/894] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:03:51 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:03:51.632938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-71e99cb8-7fcd-40b3-8a8f-09415e68ca07 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:51.633463 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-71e99cb8-7fcd-40b3-8a8f-09415e68ca07 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 62e69036-90a3-4f5d-a79e-74bc3dc4467c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:51.640177 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-71e99cb8-7fcd-40b3-8a8f-09415e68ca07 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:51.640626 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-71e99cb8-7fcd-40b3-8a8f-09415e68ca07 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:51.641425 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-71e99cb8-7fcd-40b3-8a8f-09415e68ca07 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:51.641867 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-71e99cb8-7fcd-40b3-8a8f-09415e68ca07 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:51.724210 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-71e99cb8-7fcd-40b3-8a8f-09415e68ca07 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lazy-loading 'services' on Instance uuid 62e69036-90a3-4f5d-a79e-74bc3dc4467c {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:03:51.750678 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-371c55cb-0e99-4107-b6ba-489c99031749 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:51.751300 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-371c55cb-0e99-4107-b6ba-489c99031749 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:51.757241 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-371c55cb-0e99-4107-b6ba-489c99031749 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:51.757700 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-371c55cb-0e99-4107-b6ba-489c99031749 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:51.758487 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-371c55cb-0e99-4107-b6ba-489c99031749 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:51.758910 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-371c55cb-0e99-4107-b6ba-489c99031749 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:51.797530 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-71e99cb8-7fcd-40b3-8a8f-09415e68ca07 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "DELETE /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c/os-volume_attachments/8cfc764c-15d7-4fcb-bb13-525c855a2441" status: 202 len: 0 microversion: 2.1 time: 0.168260 May 26 14:03:51.801383 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 466/895] 10.222.0.91 () {58 vars in 1415 bytes} [Thu May 26 14:03:51 2022] DELETE /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c/os-volume_attachments/8cfc764c-15d7-4fcb-bb13-525c855a2441 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:03:51.893749 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-371c55cb-0e99-4107-b6ba-489c99031749 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:51.901133 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-371c55cb-0e99-4107-b6ba-489c99031749 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 200 len: 1367 microversion: 2.1 time: 0.154716 May 26 14:03:51.901721 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 430/896] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:51 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:03:52.257861 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-de7724f0-719f-4010-a0dc-ee4ff154d5ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:52.258598 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-de7724f0-719f-4010-a0dc-ee4ff154d5ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:52.265013 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-de7724f0-719f-4010-a0dc-ee4ff154d5ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:52.265597 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-de7724f0-719f-4010-a0dc-ee4ff154d5ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:52.266357 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-de7724f0-719f-4010-a0dc-ee4ff154d5ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:52.266793 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-de7724f0-719f-4010-a0dc-ee4ff154d5ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:52.394258 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-de7724f0-719f-4010-a0dc-ee4ff154d5ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:52.402140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-de7724f0-719f-4010-a0dc-ee4ff154d5ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:52.403639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-de7724f0-719f-4010-a0dc-ee4ff154d5ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:52.405358 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-de7724f0-719f-4010-a0dc-ee4ff154d5ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1724 microversion: 2.20 time: 0.151234 May 26 14:03:52.406038 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 467/897] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:03:52 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:03:52.917112 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1d942d02-14e0-44c0-bc19-3ff45d27c8de tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:52.917741 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1d942d02-14e0-44c0-bc19-3ff45d27c8de tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:52.924159 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d942d02-14e0-44c0-bc19-3ff45d27c8de tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:52.924602 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d942d02-14e0-44c0-bc19-3ff45d27c8de tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:52.925391 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d942d02-14e0-44c0-bc19-3ff45d27c8de tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:52.925819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d942d02-14e0-44c0-bc19-3ff45d27c8de tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:53.050967 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1d942d02-14e0-44c0-bc19-3ff45d27c8de tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:53.058271 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1d942d02-14e0-44c0-bc19-3ff45d27c8de tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 200 len: 1367 microversion: 2.1 time: 0.144982 May 26 14:03:53.058826 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 431/898] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:52 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:53.423504 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f1e67969-18a8-4bfe-ad01-07c6ada832c4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:53.424046 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f1e67969-18a8-4bfe-ad01-07c6ada832c4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:53.430511 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1e67969-18a8-4bfe-ad01-07c6ada832c4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:53.430962 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1e67969-18a8-4bfe-ad01-07c6ada832c4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:53.431729 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1e67969-18a8-4bfe-ad01-07c6ada832c4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:53.432161 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1e67969-18a8-4bfe-ad01-07c6ada832c4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:53.564527 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f1e67969-18a8-4bfe-ad01-07c6ada832c4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:53.573323 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f1e67969-18a8-4bfe-ad01-07c6ada832c4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:53.574813 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f1e67969-18a8-4bfe-ad01-07c6ada832c4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:53.575955 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f1e67969-18a8-4bfe-ad01-07c6ada832c4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1724 microversion: 2.20 time: 0.156494 May 26 14:03:53.576548 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 468/899] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:03:53 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:03:54.003486 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-bafa6fe3-97d7-44c8-aecf-6da3fdfd7180 req-3e4d3d52-57af-4951-aac8-ae285208028c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9116ee60-50e6-48c5-bcc1-8e9d08e35458", "name": "network-vif-deleted", "tag": "0d486a1e-7691-438f-a89c-df9425b682f1"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:03:54.012404 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-bafa6fe3-97d7-44c8-aecf-6da3fdfd7180 req-3e4d3d52-57af-4951-aac8-ae285208028c service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:54.012854 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-bafa6fe3-97d7-44c8-aecf-6da3fdfd7180 req-3e4d3d52-57af-4951-aac8-ae285208028c service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:54.026518 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-bafa6fe3-97d7-44c8-aecf-6da3fdfd7180 req-3e4d3d52-57af-4951-aac8-ae285208028c service nova] Creating event network-vif-deleted:0d486a1e-7691-438f-a89c-df9425b682f1 for instance 9116ee60-50e6-48c5-bcc1-8e9d08e35458 on hv-cinder-84213 May 26 14:03:54.032294 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-bafa6fe3-97d7-44c8-aecf-6da3fdfd7180 req-3e4d3d52-57af-4951-aac8-ae285208028c service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032481 May 26 14:03:54.032899 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 432/900] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:03:54.074721 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-66e8d476-a042-4afd-8807-2635fc5ddf82 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:54.075336 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-66e8d476-a042-4afd-8807-2635fc5ddf82 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:54.082462 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-66e8d476-a042-4afd-8807-2635fc5ddf82 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:54.082959 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-66e8d476-a042-4afd-8807-2635fc5ddf82 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:54.083808 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-66e8d476-a042-4afd-8807-2635fc5ddf82 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:54.084231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-66e8d476-a042-4afd-8807-2635fc5ddf82 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:54.227590 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-66e8d476-a042-4afd-8807-2635fc5ddf82 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:54.236064 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-66e8d476-a042-4afd-8807-2635fc5ddf82 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 200 len: 1557 microversion: 2.1 time: 0.165860 May 26 14:03:54.236780 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 469/901] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:54 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 1557 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:54.253450 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bfca0091-eb40-455e-9372-6daf842896a1 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:54.254021 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bfca0091-eb40-455e-9372-6daf842896a1 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:54.260438 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bfca0091-eb40-455e-9372-6daf842896a1 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:54.260894 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bfca0091-eb40-455e-9372-6daf842896a1 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:54.261689 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bfca0091-eb40-455e-9372-6daf842896a1 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:54.262118 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bfca0091-eb40-455e-9372-6daf842896a1 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:54.343379 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bfca0091-eb40-455e-9372-6daf842896a1 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094746 May 26 14:03:54.344040 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 433/902] 10.222.0.91 () {58 vars in 1274 bytes} [Thu May 26 14:03:54 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:03:54.599202 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-15f32fd4-ab0c-47f0-b772-8068e2b6ff6f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:54.601863 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-15f32fd4-ab0c-47f0-b772-8068e2b6ff6f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:54.618373 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-15f32fd4-ab0c-47f0-b772-8068e2b6ff6f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:54.625199 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-15f32fd4-ab0c-47f0-b772-8068e2b6ff6f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:54.626320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-15f32fd4-ab0c-47f0-b772-8068e2b6ff6f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:54.626889 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-15f32fd4-ab0c-47f0-b772-8068e2b6ff6f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:54.893201 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-15f32fd4-ab0c-47f0-b772-8068e2b6ff6f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:54.904084 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-15f32fd4-ab0c-47f0-b772-8068e2b6ff6f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:54.906672 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-15f32fd4-ab0c-47f0-b772-8068e2b6ff6f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:54.909203 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-15f32fd4-ab0c-47f0-b772-8068e2b6ff6f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 200 len: 1367 microversion: 2.20 time: 0.314117 May 26 14:03:54.910025 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 470/903] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:03:54 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 1367 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:03:55.634352 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-84c9e48d-84ff-49ac-b3f1-bd4f6c4a038f req-2fdc10b2-5b5c-46fc-b3f5-f57716ffdfd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6c7fc24-24aa-48ea-b184-38585d2ffb40", "tag": "36211193-9c2e-4666-9039-2f26d4b7c02d"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:03:55.643327 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-84c9e48d-84ff-49ac-b3f1-bd4f6c4a038f req-2fdc10b2-5b5c-46fc-b3f5-f57716ffdfd8 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:55.643776 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-84c9e48d-84ff-49ac-b3f1-bd4f6c4a038f req-2fdc10b2-5b5c-46fc-b3f5-f57716ffdfd8 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:55.654940 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-84c9e48d-84ff-49ac-b3f1-bd4f6c4a038f req-2fdc10b2-5b5c-46fc-b3f5-f57716ffdfd8 service nova] Creating event network-changed:36211193-9c2e-4666-9039-2f26d4b7c02d for instance d6c7fc24-24aa-48ea-b184-38585d2ffb40 on hv-cinder-84213 May 26 14:03:55.659879 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-84c9e48d-84ff-49ac-b3f1-bd4f6c4a038f req-2fdc10b2-5b5c-46fc-b3f5-f57716ffdfd8 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029674 May 26 14:03:55.660657 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 434/904] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:03:55.931761 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-88fb52f9-2a81-44cf-83c5-3a53b6345497 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:55.932746 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-88fb52f9-2a81-44cf-83c5-3a53b6345497 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:55.939255 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-88fb52f9-2a81-44cf-83c5-3a53b6345497 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:55.939705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-88fb52f9-2a81-44cf-83c5-3a53b6345497 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:55.940467 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-88fb52f9-2a81-44cf-83c5-3a53b6345497 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:55.940899 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-88fb52f9-2a81-44cf-83c5-3a53b6345497 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:55.955946 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-88fb52f9-2a81-44cf-83c5-3a53b6345497 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] HTTP exception thrown: Instance 9116ee60-50e6-48c5-bcc1-8e9d08e35458 could not be found. May 26 14:03:55.957624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-88fb52f9-2a81-44cf-83c5-3a53b6345497 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Request method failure captured: May 26 14:03:55.957624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 HTTP/1.1 May 26 14:03:55.957624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 14:03:55.957624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 14:03:55.957624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 14:03:55.957624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 14:03:55.957624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 14:03:55.957624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 14:03:55.957624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 14:03:55.957624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 14:03:55.957624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4b73dD-28Z-kviSgN8tUFPMh5TAFeR--fqt6ww-Ip21LiNgjxfZeTR33fuZHIqJ8l73mEQYpiYB16IjIlAY0GhixNdHj73x1gqIuul6-vbrKho1_s_D9hxCOl_hu_VeJsILK7Omb6oKF0NZd2H0lHPKfa2h8pBVd8un4U2-1g34JLU May 26 14:03:55.957624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 14:03:55.957624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 14:03:55.957624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 14:03:55.957624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 14:03:55.957624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Openstack-Nova-Api-Version: 2.20 May 26 14:03:55.957624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 14:03:55.957624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 14:03:55.957624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: 7116b23d173c4192a6c8d996ad31d57c May 26 14:03:55.957624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-460056092 May 26 14:03:55.957624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 14:03:55.957624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 14:03:55.959364 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/7116b23d173c4192a6c8d996ad31d57c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/7116b23d173c4192a6c8d996ad31d57c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/7116b23d173c4192a6c8d996ad31d57c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_7116b23d173c4192a6c8d996ad31d57c", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:03:55.959364 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeShelveTestJSON-460056092 May 26 14:03:55.959364 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 7116b23d173c4192a6c8d996ad31d57c May 26 14:03:55.959364 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-460056092 May 26 14:03:55.959364 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeShelveTestJSON-460056092-project May 26 14:03:55.959364 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 14:03:55.959364 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 14:03:55.959364 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: c67205b7150c460a81ff545d5ba29cad May 26 14:03:55.959364 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeShelveTestJSON-460056092-project May 26 14:03:55.959364 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 14:03:55.959364 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Instance 9116ee60-50e6-48c5-bcc1-8e9d08e35458 could not be found. May 26 14:03:55.959364 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': '9116ee60-50e6-48c5-bcc1-8e9d08e35458'} May 26 14:03:55.960470 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:03:55.960470 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:03:55.960470 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:03:55.960470 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:03:55.960470 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:03:55.960470 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:03:55.960470 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:03:55.960470 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:03:55.960470 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:03:55.960470 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:03:55.960470 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9116ee60-50e6-48c5-bcc1-8e9d08e35458 could not be found. May 26 14:03:55.960470 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:03:55.960470 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:03:55.960470 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:03:55.960470 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:03:55.960470 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:03:55.960470 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:03:55.960470 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:03:55.960470 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:03:55.960470 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:03:55.961940 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:03:55.961940 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:03:55.961940 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:03:55.961940 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:03:55.961940 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:03:55.961940 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:03:55.961940 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:03:55.961940 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9116ee60-50e6-48c5-bcc1-8e9d08e35458 could not be found. May 26 14:03:55.961940 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:03:55.961940 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:03:55.961940 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:03:55.961940 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:03:55.961940 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:03:55.961940 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:03:55.961940 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:03:55.961940 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:03:55.961940 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9116ee60-50e6-48c5-bcc1-8e9d08e35458 could not be found. May 26 14:03:55.961940 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:03:55.963768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-88fb52f9-2a81-44cf-83c5-3a53b6345497 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Returning 404 to user: Instance 9116ee60-50e6-48c5-bcc1-8e9d08e35458 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:03:55.963768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-88fb52f9-2a81-44cf-83c5-3a53b6345497 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 404 len: 111 microversion: 2.20 time: 0.031216 May 26 14:03:55.963768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 471/905] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:03:55 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 14:03:55.970525 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-844a8a7b-afb7-4dc1-b789-7d223f13c90d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '.version_select at 0x7f25a4b50a60>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:55.991864 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-844a8a7b-afb7-4dc1-b789-7d223f13c90d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1648317980" status: 204 len: 0 microversion: 2.20 time: 0.025624 May 26 14:03:55.992683 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 435/906] 10.222.0.91 () {60 vars in 1261 bytes} [Thu May 26 14:03:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1648317980 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 14:03:56.149024 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3762e8e3-7fa4-43aa-8369-7751d9b0f5fd tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:56.149955 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3762e8e3-7fa4-43aa-8369-7751d9b0f5fd tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 62e69036-90a3-4f5d-a79e-74bc3dc4467c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:56.165783 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3762e8e3-7fa4-43aa-8369-7751d9b0f5fd tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:56.166651 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3762e8e3-7fa4-43aa-8369-7751d9b0f5fd tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:56.167634 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3762e8e3-7fa4-43aa-8369-7751d9b0f5fd tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:56.168228 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3762e8e3-7fa4-43aa-8369-7751d9b0f5fd tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:56.205028 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3762e8e3-7fa4-43aa-8369-7751d9b0f5fd tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 62e69036-90a3-4f5d-a79e-74bc3dc4467c] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 14:03:56.311863 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3762e8e3-7fa4-43aa-8369-7751d9b0f5fd tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "DELETE /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c" status: 204 len: 0 microversion: 2.1 time: 0.166180 May 26 14:03:56.312599 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 472/907] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 14:03:56 2022] DELETE /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 14:03:56.324549 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d66a62db-00ef-4549-9b01-9a6d117e0c85 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:56.327095 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d66a62db-00ef-4549-9b01-9a6d117e0c85 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 62e69036-90a3-4f5d-a79e-74bc3dc4467c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:56.336225 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d66a62db-00ef-4549-9b01-9a6d117e0c85 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:56.337307 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d66a62db-00ef-4549-9b01-9a6d117e0c85 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:56.340277 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d66a62db-00ef-4549-9b01-9a6d117e0c85 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:56.340972 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d66a62db-00ef-4549-9b01-9a6d117e0c85 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:56.578761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d66a62db-00ef-4549-9b01-9a6d117e0c85 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:56.587594 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d66a62db-00ef-4549-9b01-9a6d117e0c85 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c" status: 200 len: 1512 microversion: 2.1 time: 0.269891 May 26 14:03:56.588268 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 436/908] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:56 2022] GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c => generated 1512 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:56.849471 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-22106fd0-1aef-4299-9ed0-019a221739cb tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:03:56.850336 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-22106fd0-1aef-4299-9ed0-019a221739cb tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:56.856266 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-22106fd0-1aef-4299-9ed0-019a221739cb tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:56.856658 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-22106fd0-1aef-4299-9ed0-019a221739cb tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:56.858509 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-22106fd0-1aef-4299-9ed0-019a221739cb tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:56.859107 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-22106fd0-1aef-4299-9ed0-019a221739cb tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:56.875513 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3f31b4f1-e445-4fa7-b617-4a1fa94af85a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Action: 'create', calling method: .version_select at 0x7f25a4b509d0>, body: {"keypair": {"name": "tempest-keypair-92658048", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLehl7+SYutJlRC5Zf0yQR/JxqKaeySDWczrJTW9Mt0TLDwbp70cJvbocLDN6ftJBuuLvnut313yqtFcyZoceO3yWGUtE+6BPUkkg+JYbu/YqVD/Ny2Ml2rrcPD/OqUHKQ=="}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:03:56.910862 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-3f31b4f1-e445-4fa7-b617-4a1fa94af85a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Getting quotas for project 7116b23d173c4192a6c8d996ad31d57c. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 14:03:56.916069 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-3f31b4f1-e445-4fa7-b617-4a1fa94af85a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Getting quotas for user c67205b7150c460a81ff545d5ba29cad and project 7116b23d173c4192a6c8d996ad31d57c. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 14:03:56.944011 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3f31b4f1-e445-4fa7-b617-4a1fa94af85a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.072534 May 26 14:03:56.944639 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 437/909] 10.222.0.91 () {62 vars in 1199 bytes} [Thu May 26 14:03:56 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 74 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 14:03:57.046524 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-22106fd0-1aef-4299-9ed0-019a221739cb tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lazy-loading 'flavor' on Instance uuid 4176fdc7-3ccd-4093-b4c4-841eafb524f7 {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:03:57.050304 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:57.142001 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-22106fd0-1aef-4299-9ed0-019a221739cb tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "POST /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7/action" status: 202 len: 0 microversion: 2.1 time: 0.296076 May 26 14:03:57.142939 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 473/910] 10.222.0.91 () {60 vars in 1277 bytes} [Thu May 26 14:03:56 2022] POST /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:03:57.152047 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-962a160c-3896-4710-9d9b-e0405e1613ab tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:57.152724 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-962a160c-3896-4710-9d9b-e0405e1613ab tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:57.161468 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-962a160c-3896-4710-9d9b-e0405e1613ab tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:57.161986 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-962a160c-3896-4710-9d9b-e0405e1613ab tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:57.162816 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-962a160c-3896-4710-9d9b-e0405e1613ab tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:57.163262 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-962a160c-3896-4710-9d9b-e0405e1613ab tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:57.321039 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-962a160c-3896-4710-9d9b-e0405e1613ab tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:57.328913 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-962a160c-3896-4710-9d9b-e0405e1613ab tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1568 microversion: 2.1 time: 0.181065 May 26 14:03:57.329516 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 438/911] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:57 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:03:57.606727 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-681f06c1-3335-4ee1-b4a6-ce89a5d24144 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:57.607439 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-681f06c1-3335-4ee1-b4a6-ce89a5d24144 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 62e69036-90a3-4f5d-a79e-74bc3dc4467c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:57.614450 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-681f06c1-3335-4ee1-b4a6-ce89a5d24144 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:57.614903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-681f06c1-3335-4ee1-b4a6-ce89a5d24144 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:57.615684 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-681f06c1-3335-4ee1-b4a6-ce89a5d24144 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:57.616120 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-681f06c1-3335-4ee1-b4a6-ce89a5d24144 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:57.759941 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-681f06c1-3335-4ee1-b4a6-ce89a5d24144 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:57.768298 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-681f06c1-3335-4ee1-b4a6-ce89a5d24144 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c" status: 200 len: 1512 microversion: 2.1 time: 0.166206 May 26 14:03:57.768981 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 474/912] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:57 2022] GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:58.314681 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-16d1c0da-735d-4f68-b9e6-8112f52b44ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2104632487", "imageRef": "bcaacfae-fe2c-455f-a6e1-b08361c6fa8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b5ae806-b190-4516-8465-70dba440ef62"}], "security_groups": [{"name": "tempest-securitygroup--294836318"}], "key_name": "tempest-keypair-92658048", "user_data": "}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:03:58.321809 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:58.347201 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d597acec-b80b-490d-9de3-25a7c68a6804 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:58.347894 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d597acec-b80b-490d-9de3-25a7c68a6804 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:58.354575 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d597acec-b80b-490d-9de3-25a7c68a6804 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:58.355118 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d597acec-b80b-490d-9de3-25a7c68a6804 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:58.356029 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d597acec-b80b-490d-9de3-25a7c68a6804 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:58.356471 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d597acec-b80b-490d-9de3-25a7c68a6804 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:58.458298 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-16d1c0da-735d-4f68-b9e6-8112f52b44ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] validate_networks() for [('8b5ae806-b190-4516-8465-70dba440ef62', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 14:03:58.561710 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d597acec-b80b-490d-9de3-25a7c68a6804 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:58.569173 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d597acec-b80b-490d-9de3-25a7c68a6804 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1568 microversion: 2.1 time: 0.225942 May 26 14:03:58.569832 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 475/913] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:58 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:03:58.785474 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f150c8d9-55d8-4ae2-85e2-ffb5fda341c4 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:58.786089 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f150c8d9-55d8-4ae2-85e2-ffb5fda341c4 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 62e69036-90a3-4f5d-a79e-74bc3dc4467c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:58.792378 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f150c8d9-55d8-4ae2-85e2-ffb5fda341c4 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:58.792829 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f150c8d9-55d8-4ae2-85e2-ffb5fda341c4 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:58.793671 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f150c8d9-55d8-4ae2-85e2-ffb5fda341c4 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:58.794105 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f150c8d9-55d8-4ae2-85e2-ffb5fda341c4 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:58.885180 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-16d1c0da-735d-4f68-b9e6-8112f52b44ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 14:03:58.885627 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-16d1c0da-735d-4f68-b9e6-8112f52b44ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 14:03:58.886457 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-16d1c0da-735d-4f68-b9e6-8112f52b44ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 14:03:58.887051 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-16d1c0da-735d-4f68-b9e6-8112f52b44ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 14:03:58.887472 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-16d1c0da-735d-4f68-b9e6-8112f52b44ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 14:03:58.897212 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-16d1c0da-735d-4f68-b9e6-8112f52b44ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:58.897548 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-16d1c0da-735d-4f68-b9e6-8112f52b44ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:58.903726 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-16d1c0da-735d-4f68-b9e6-8112f52b44ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:58.904814 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-16d1c0da-735d-4f68-b9e6-8112f52b44ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:58.924618 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-16d1c0da-735d-4f68-b9e6-8112f52b44ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Getting quotas for project 7116b23d173c4192a6c8d996ad31d57c. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 14:03:58.929058 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-16d1c0da-735d-4f68-b9e6-8112f52b44ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Getting quotas for user c67205b7150c460a81ff545d5ba29cad and project 7116b23d173c4192a6c8d996ad31d57c. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 14:03:58.943499 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-16d1c0da-735d-4f68-b9e6-8112f52b44ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 14:03:58.945920 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-16d1c0da-735d-4f68-b9e6-8112f52b44ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bcaacfae-fe2c-455f-a6e1-b08361c6fa8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 14:03:58.967764 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f150c8d9-55d8-4ae2-85e2-ffb5fda341c4 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:58.976114 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f150c8d9-55d8-4ae2-85e2-ffb5fda341c4 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c" status: 200 len: 1512 microversion: 2.1 time: 0.194557 May 26 14:03:58.977003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 476/914] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:58 2022] GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c => generated 1512 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:03:58.995853 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-16d1c0da-735d-4f68-b9e6-8112f52b44ce tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.685522 May 26 14:03:58.996757 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 439/915] 10.222.0.91 () {62 vars in 1187 bytes} [Thu May 26 14:03:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 14:03:59.007651 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b67fac9f-8100-46f1-8e2a-ed94b5476e77 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:59.008349 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b67fac9f-8100-46f1-8e2a-ed94b5476e77 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:59.068393 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b67fac9f-8100-46f1-8e2a-ed94b5476e77 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:59.077278 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b67fac9f-8100-46f1-8e2a-ed94b5476e77 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:59.078906 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b67fac9f-8100-46f1-8e2a-ed94b5476e77 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:59.080109 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b67fac9f-8100-46f1-8e2a-ed94b5476e77 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1280 microversion: 2.20 time: 0.076763 May 26 14:03:59.089243 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 477/916] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:03:59 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:03:59.316305 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-15b4ae55-2ebd-47a7-b55b-98422e966419 req-a40660b5-7237-4fd3-92d2-fb8bba1cac06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e69036-90a3-4f5d-a79e-74bc3dc4467c", "name": "network-vif-deleted", "tag": "3e9da444-5e7d-4d3e-974b-0f95030b725d"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:03:59.329317 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-15b4ae55-2ebd-47a7-b55b-98422e966419 req-a40660b5-7237-4fd3-92d2-fb8bba1cac06 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:59.329766 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-15b4ae55-2ebd-47a7-b55b-98422e966419 req-a40660b5-7237-4fd3-92d2-fb8bba1cac06 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:59.350328 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-15b4ae55-2ebd-47a7-b55b-98422e966419 req-a40660b5-7237-4fd3-92d2-fb8bba1cac06 service nova] Creating event network-vif-deleted:3e9da444-5e7d-4d3e-974b-0f95030b725d for instance 62e69036-90a3-4f5d-a79e-74bc3dc4467c on hv-cinder-84213 May 26 14:03:59.357646 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-15b4ae55-2ebd-47a7-b55b-98422e966419 req-a40660b5-7237-4fd3-92d2-fb8bba1cac06 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044874 May 26 14:03:59.358575 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 440/917] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:03:59.587202 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-67baf9af-e6c1-43ec-9f1b-7b672e603feb tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:59.587798 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-67baf9af-e6c1-43ec-9f1b-7b672e603feb tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:59.595059 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-67baf9af-e6c1-43ec-9f1b-7b672e603feb tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:59.595862 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-67baf9af-e6c1-43ec-9f1b-7b672e603feb tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:59.596848 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-67baf9af-e6c1-43ec-9f1b-7b672e603feb tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:59.597353 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-67baf9af-e6c1-43ec-9f1b-7b672e603feb tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:59.732157 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-67baf9af-e6c1-43ec-9f1b-7b672e603feb tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:59.740217 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-67baf9af-e6c1-43ec-9f1b-7b672e603feb tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1568 microversion: 2.1 time: 0.157198 May 26 14:03:59.740783 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 478/918] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:59 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:59.994418 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3ae5b73e-87a9-413e-a500-a6e91a1ea8df tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:59.995170 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3ae5b73e-87a9-413e-a500-a6e91a1ea8df tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 62e69036-90a3-4f5d-a79e-74bc3dc4467c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:00.001635 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3ae5b73e-87a9-413e-a500-a6e91a1ea8df tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:00.002081 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3ae5b73e-87a9-413e-a500-a6e91a1ea8df tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:00.002843 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3ae5b73e-87a9-413e-a500-a6e91a1ea8df tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:00.003272 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3ae5b73e-87a9-413e-a500-a6e91a1ea8df tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:00.037037 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3ae5b73e-87a9-413e-a500-a6e91a1ea8df tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:00.037515 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3ae5b73e-87a9-413e-a500-a6e91a1ea8df tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:00.038272 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-3ae5b73e-87a9-413e-a500-a6e91a1ea8df tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lazy-loading 'fault' on Instance uuid 62e69036-90a3-4f5d-a79e-74bc3dc4467c {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:04:00.086261 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3ae5b73e-87a9-413e-a500-a6e91a1ea8df tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3425e6afcbf4d20bf4229ba6d93c8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a1b861d3d84f309ff5a1e90f7499fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:00.093805 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3ae5b73e-87a9-413e-a500-a6e91a1ea8df tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c" status: 200 len: 1307 microversion: 2.1 time: 0.103731 May 26 14:04:00.094375 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 441/919] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:03:59 2022] GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c => generated 1307 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:00.099123 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-31d78968-ab45-49b3-b009-a9178afc99b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:00.099750 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-31d78968-ab45-49b3-b009-a9178afc99b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:00.106075 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-31d78968-ab45-49b3-b009-a9178afc99b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:00.106452 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-31d78968-ab45-49b3-b009-a9178afc99b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:00.107218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-31d78968-ab45-49b3-b009-a9178afc99b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:00.108243 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-31d78968-ab45-49b3-b009-a9178afc99b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:00.171628 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-31d78968-ab45-49b3-b009-a9178afc99b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:00.180422 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-31d78968-ab45-49b3-b009-a9178afc99b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:00.182454 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-31d78968-ab45-49b3-b009-a9178afc99b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:00.183219 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-31d78968-ab45-49b3-b009-a9178afc99b6 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1332 microversion: 2.20 time: 0.088023 May 26 14:04:00.183802 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 479/920] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:04:00 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1332 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:04:00.757640 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1bd4207d-8eec-4dc7-bef7-fe8785af76c4 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:00.758250 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1bd4207d-8eec-4dc7-bef7-fe8785af76c4 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:00.765367 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1bd4207d-8eec-4dc7-bef7-fe8785af76c4 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:00.765819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1bd4207d-8eec-4dc7-bef7-fe8785af76c4 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:00.766590 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1bd4207d-8eec-4dc7-bef7-fe8785af76c4 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:00.767029 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1bd4207d-8eec-4dc7-bef7-fe8785af76c4 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:00.904557 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1bd4207d-8eec-4dc7-bef7-fe8785af76c4 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:00.912306 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1bd4207d-8eec-4dc7-bef7-fe8785af76c4 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1568 microversion: 2.1 time: 0.158448 May 26 14:04:00.912881 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 442/921] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:00 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:01.112155 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b336dc49-03fe-4a85-af96-8d8853167334 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:01.113025 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b336dc49-03fe-4a85-af96-8d8853167334 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] [instance: 62e69036-90a3-4f5d-a79e-74bc3dc4467c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:01.120250 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b336dc49-03fe-4a85-af96-8d8853167334 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:01.120942 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b336dc49-03fe-4a85-af96-8d8853167334 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:01.121815 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b336dc49-03fe-4a85-af96-8d8853167334 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:01.122315 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b336dc49-03fe-4a85-af96-8d8853167334 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:01.137272 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-b336dc49-03fe-4a85-af96-8d8853167334 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] HTTP exception thrown: Instance 62e69036-90a3-4f5d-a79e-74bc3dc4467c could not be found. May 26 14:04:01.139051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b336dc49-03fe-4a85-af96-8d8853167334 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Request method failure captured: May 26 14:04:01.139051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c HTTP/1.1 May 26 14:04:01.139051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 14:04:01.139051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 14:04:01.139051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 14:04:01.139051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 14:04:01.139051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 14:04:01.139051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 14:04:01.139051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 14:04:01.139051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 14:04:01.139051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4hHtI85T4iYTReeyKyp0Zs3RnarImaZnY6B-2gt8EquQ5EddwDc2kuTf2TX72VJ3TzKQKfrR1sSjdkT9CfUjC1PRIZam3wS0h9n4uGYYFvE0uAidwTbrDI2syGyBsgg--vETEexOrjnYclNr44oDLYSqWDDAj9lq4Z4asGpJFv2l78 May 26 14:04:01.139051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 14:04:01.139051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 14:04:01.139051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 14:04:01.139051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 14:04:01.139051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 14:04:01.139051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 14:04:01.139051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: 98a1b861d3d84f309ff5a1e90f7499fd May 26 14:04:01.139051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1677528382 May 26 14:04:01.139051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 14:04:01.139051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 14:04:01.140750 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/98a1b861d3d84f309ff5a1e90f7499fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/98a1b861d3d84f309ff5a1e90f7499fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/98a1b861d3d84f309ff5a1e90f7499fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_98a1b861d3d84f309ff5a1e90f7499fd", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:04:01.140750 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-VolumesSnapshotTestJSON-1677528382 May 26 14:04:01.140750 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 98a1b861d3d84f309ff5a1e90f7499fd May 26 14:04:01.140750 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1677528382 May 26 14:04:01.140750 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-VolumesSnapshotTestJSON-1677528382-project May 26 14:04:01.140750 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 14:04:01.140750 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 14:04:01.140750 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: d3425e6afcbf4d20bf4229ba6d93c8ff May 26 14:04:01.140750 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-VolumesSnapshotTestJSON-1677528382-project May 26 14:04:01.140750 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 14:04:01.140750 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Instance 62e69036-90a3-4f5d-a79e-74bc3dc4467c could not be found. May 26 14:04:01.140750 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': '62e69036-90a3-4f5d-a79e-74bc3dc4467c'} May 26 14:04:01.142065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:04:01.142065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:04:01.142065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:04:01.142065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:04:01.142065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:04:01.142065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:04:01.142065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:04:01.142065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:04:01.142065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:04:01.142065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:04:01.142065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62e69036-90a3-4f5d-a79e-74bc3dc4467c could not be found. May 26 14:04:01.142065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:04:01.142065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:04:01.142065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:04:01.142065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:04:01.142065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:04:01.142065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:04:01.142065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:04:01.142065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:04:01.142065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:04:01.143854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:04:01.143854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:04:01.143854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:04:01.143854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:04:01.143854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:04:01.143854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:04:01.143854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:04:01.143854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62e69036-90a3-4f5d-a79e-74bc3dc4467c could not be found. May 26 14:04:01.143854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:04:01.143854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:04:01.143854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:04:01.143854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:04:01.143854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:04:01.143854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:04:01.143854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:04:01.143854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:04:01.143854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62e69036-90a3-4f5d-a79e-74bc3dc4467c could not be found. May 26 14:04:01.143854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:04:01.146063 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b336dc49-03fe-4a85-af96-8d8853167334 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] Returning 404 to user: Instance 62e69036-90a3-4f5d-a79e-74bc3dc4467c could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:04:01.146063 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b336dc49-03fe-4a85-af96-8d8853167334 tempest-VolumesSnapshotTestJSON-1677528382 tempest-VolumesSnapshotTestJSON-1677528382-project] 10.222.0.91 "GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c" status: 404 len: 111 microversion: 2.1 time: 0.034857 May 26 14:04:01.147318 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 480/922] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:01 2022] GET /compute/v2.1/servers/62e69036-90a3-4f5d-a79e-74bc3dc4467c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:04:01.202203 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-25636354-a425-423e-996a-d9cb31523f11 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:01.203873 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-25636354-a425-423e-996a-d9cb31523f11 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:01.211041 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-25636354-a425-423e-996a-d9cb31523f11 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:01.211754 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-25636354-a425-423e-996a-d9cb31523f11 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:01.212709 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-25636354-a425-423e-996a-d9cb31523f11 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:01.213330 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-25636354-a425-423e-996a-d9cb31523f11 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:01.219371 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:01.291595 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-25636354-a425-423e-996a-d9cb31523f11 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:01.302534 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-25636354-a425-423e-996a-d9cb31523f11 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:01.304716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-25636354-a425-423e-996a-d9cb31523f11 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:01.306291 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-25636354-a425-423e-996a-d9cb31523f11 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1338 microversion: 2.20 time: 0.108844 May 26 14:04:01.307704 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 443/923] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:04:01 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1338 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:04:01.933126 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-650d4ca7-d45d-47ce-966b-93e5c7fdbfc2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:01.933843 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-650d4ca7-d45d-47ce-966b-93e5c7fdbfc2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:01.941204 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-650d4ca7-d45d-47ce-966b-93e5c7fdbfc2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:01.941742 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-650d4ca7-d45d-47ce-966b-93e5c7fdbfc2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:01.942661 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-650d4ca7-d45d-47ce-966b-93e5c7fdbfc2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:01.943166 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-650d4ca7-d45d-47ce-966b-93e5c7fdbfc2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:02.103651 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-650d4ca7-d45d-47ce-966b-93e5c7fdbfc2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:02.113296 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-650d4ca7-d45d-47ce-966b-93e5c7fdbfc2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1568 microversion: 2.1 time: 0.186754 May 26 14:04:02.114336 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 481/924] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:01 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:02.168043 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-c6f06534-9a89-477e-b921-119c2ced67ca req-921238db-f21b-4b92-9ea1-22b2bbb8dff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7", "tag": "703563f0-f1dc-4261-919d-1995757e7da5"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:04:02.195740 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-c6f06534-9a89-477e-b921-119c2ced67ca req-921238db-f21b-4b92-9ea1-22b2bbb8dff7 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:02.196422 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-c6f06534-9a89-477e-b921-119c2ced67ca req-921238db-f21b-4b92-9ea1-22b2bbb8dff7 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:02.216306 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-c6f06534-9a89-477e-b921-119c2ced67ca req-921238db-f21b-4b92-9ea1-22b2bbb8dff7 service nova] Creating event network-changed:703563f0-f1dc-4261-919d-1995757e7da5 for instance 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 on hv-cinder-84213 May 26 14:04:02.222611 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-c6f06534-9a89-477e-b921-119c2ced67ca req-921238db-f21b-4b92-9ea1-22b2bbb8dff7 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066603 May 26 14:04:02.223336 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 444/925] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:04:02.326234 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-47ad8433-7746-4ea6-ab82-96c24db1c72e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:02.328164 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-47ad8433-7746-4ea6-ab82-96c24db1c72e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:02.338595 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-47ad8433-7746-4ea6-ab82-96c24db1c72e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:02.339250 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-47ad8433-7746-4ea6-ab82-96c24db1c72e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:02.340117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-47ad8433-7746-4ea6-ab82-96c24db1c72e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:02.340690 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-47ad8433-7746-4ea6-ab82-96c24db1c72e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:02.482183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-47ad8433-7746-4ea6-ab82-96c24db1c72e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:02.490999 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-47ad8433-7746-4ea6-ab82-96c24db1c72e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:02.492543 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-47ad8433-7746-4ea6-ab82-96c24db1c72e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:02.493695 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-47ad8433-7746-4ea6-ab82-96c24db1c72e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1405 microversion: 2.20 time: 0.171724 May 26 14:04:02.494256 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 482/926] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:04:02 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:04:03.131319 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b577caf2-1fda-4193-b01c-6b4d70416279 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:03.132009 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b577caf2-1fda-4193-b01c-6b4d70416279 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:03.138264 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b577caf2-1fda-4193-b01c-6b4d70416279 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:03.139301 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b577caf2-1fda-4193-b01c-6b4d70416279 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:03.140057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b577caf2-1fda-4193-b01c-6b4d70416279 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:03.140485 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b577caf2-1fda-4193-b01c-6b4d70416279 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:03.275915 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b577caf2-1fda-4193-b01c-6b4d70416279 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:03.283601 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b577caf2-1fda-4193-b01c-6b4d70416279 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1568 microversion: 2.1 time: 0.156535 May 26 14:04:03.284167 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 445/927] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:03 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:03.512165 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-576b5ca6-297e-46b6-aa32-ec5bc4720bd4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:03.512709 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-576b5ca6-297e-46b6-aa32-ec5bc4720bd4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:03.520155 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-576b5ca6-297e-46b6-aa32-ec5bc4720bd4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:03.520604 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-576b5ca6-297e-46b6-aa32-ec5bc4720bd4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:03.521404 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-576b5ca6-297e-46b6-aa32-ec5bc4720bd4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:03.521846 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-576b5ca6-297e-46b6-aa32-ec5bc4720bd4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:03.649969 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-576b5ca6-297e-46b6-aa32-ec5bc4720bd4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:03.657906 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-576b5ca6-297e-46b6-aa32-ec5bc4720bd4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:03.659393 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-576b5ca6-297e-46b6-aa32-ec5bc4720bd4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:03.660482 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-576b5ca6-297e-46b6-aa32-ec5bc4720bd4 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1405 microversion: 2.20 time: 0.152463 May 26 14:04:03.661036 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 483/928] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:04:03 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:04:04.299811 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-11b84cd3-38ca-42dc-9448-5afe8e46e807 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:04.300459 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-11b84cd3-38ca-42dc-9448-5afe8e46e807 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:04.307079 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-11b84cd3-38ca-42dc-9448-5afe8e46e807 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:04.307578 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-11b84cd3-38ca-42dc-9448-5afe8e46e807 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:04.308363 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-11b84cd3-38ca-42dc-9448-5afe8e46e807 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:04.308798 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-11b84cd3-38ca-42dc-9448-5afe8e46e807 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:04.442558 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-11b84cd3-38ca-42dc-9448-5afe8e46e807 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:04.450573 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-11b84cd3-38ca-42dc-9448-5afe8e46e807 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1568 microversion: 2.1 time: 0.154512 May 26 14:04:04.451084 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 446/929] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:04 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:04.678513 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5f5b7c0a-304e-418c-9f65-c9c3ed0cf7bd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:04.679217 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5f5b7c0a-304e-418c-9f65-c9c3ed0cf7bd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:04.686415 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5f5b7c0a-304e-418c-9f65-c9c3ed0cf7bd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:04.686893 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5f5b7c0a-304e-418c-9f65-c9c3ed0cf7bd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:04.687667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5f5b7c0a-304e-418c-9f65-c9c3ed0cf7bd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:04.688107 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5f5b7c0a-304e-418c-9f65-c9c3ed0cf7bd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:04.818365 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5f5b7c0a-304e-418c-9f65-c9c3ed0cf7bd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:04.826373 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5f5b7c0a-304e-418c-9f65-c9c3ed0cf7bd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:04.827882 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5f5b7c0a-304e-418c-9f65-c9c3ed0cf7bd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:04.828986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5f5b7c0a-304e-418c-9f65-c9c3ed0cf7bd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1405 microversion: 2.20 time: 0.154428 May 26 14:04:04.829579 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 484/930] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:04:04 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:04:05.468418 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2d84853c-8cb7-4ba3-b450-207a189b96ac tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:05.468976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2d84853c-8cb7-4ba3-b450-207a189b96ac tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:05.475752 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2d84853c-8cb7-4ba3-b450-207a189b96ac tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:05.476209 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2d84853c-8cb7-4ba3-b450-207a189b96ac tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:05.477000 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2d84853c-8cb7-4ba3-b450-207a189b96ac tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:05.477465 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2d84853c-8cb7-4ba3-b450-207a189b96ac tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:05.610436 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2d84853c-8cb7-4ba3-b450-207a189b96ac tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:05.618350 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2d84853c-8cb7-4ba3-b450-207a189b96ac tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1568 microversion: 2.1 time: 0.153967 May 26 14:04:05.618933 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 447/931] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:05 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:05.847289 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7b221b34-6e90-4a7e-87f9-25acf1564569 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:05.847886 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7b221b34-6e90-4a7e-87f9-25acf1564569 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:05.855336 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7b221b34-6e90-4a7e-87f9-25acf1564569 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:05.855875 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7b221b34-6e90-4a7e-87f9-25acf1564569 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:05.856709 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7b221b34-6e90-4a7e-87f9-25acf1564569 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:05.857144 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7b221b34-6e90-4a7e-87f9-25acf1564569 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:05.995901 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7b221b34-6e90-4a7e-87f9-25acf1564569 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:06.011001 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7b221b34-6e90-4a7e-87f9-25acf1564569 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:06.012525 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7b221b34-6e90-4a7e-87f9-25acf1564569 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:06.013695 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7b221b34-6e90-4a7e-87f9-25acf1564569 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1405 microversion: 2.20 time: 0.170333 May 26 14:04:06.014281 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 485/932] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:04:05 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:04:06.636060 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e916f014-4d29-4f72-bfa1-46a4f4dd4bd5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:06.636708 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e916f014-4d29-4f72-bfa1-46a4f4dd4bd5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:06.644070 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e916f014-4d29-4f72-bfa1-46a4f4dd4bd5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:06.644514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e916f014-4d29-4f72-bfa1-46a4f4dd4bd5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:06.645306 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e916f014-4d29-4f72-bfa1-46a4f4dd4bd5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:06.645747 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e916f014-4d29-4f72-bfa1-46a4f4dd4bd5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:06.776309 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e916f014-4d29-4f72-bfa1-46a4f4dd4bd5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:06.783824 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e916f014-4d29-4f72-bfa1-46a4f4dd4bd5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1568 microversion: 2.1 time: 0.151643 May 26 14:04:06.784387 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 448/933] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:06 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:07.031796 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f9e4741b-316d-44bc-b698-389dd08dec3f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:07.032447 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f9e4741b-316d-44bc-b698-389dd08dec3f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:07.039052 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f9e4741b-316d-44bc-b698-389dd08dec3f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:07.039501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f9e4741b-316d-44bc-b698-389dd08dec3f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:07.040275 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f9e4741b-316d-44bc-b698-389dd08dec3f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:07.040711 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f9e4741b-316d-44bc-b698-389dd08dec3f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:07.176074 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f9e4741b-316d-44bc-b698-389dd08dec3f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:07.185573 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f9e4741b-316d-44bc-b698-389dd08dec3f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:07.187724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f9e4741b-316d-44bc-b698-389dd08dec3f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:07.188837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f9e4741b-316d-44bc-b698-389dd08dec3f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1405 microversion: 2.20 time: 0.160991 May 26 14:04:07.189437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 486/934] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:04:07 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:04:07.801721 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8bbf1a6f-b0e4-42b7-9d14-984da0a82176 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:07.802361 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8bbf1a6f-b0e4-42b7-9d14-984da0a82176 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:07.809735 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8bbf1a6f-b0e4-42b7-9d14-984da0a82176 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:07.810188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8bbf1a6f-b0e4-42b7-9d14-984da0a82176 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:07.811671 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8bbf1a6f-b0e4-42b7-9d14-984da0a82176 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:07.812138 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8bbf1a6f-b0e4-42b7-9d14-984da0a82176 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:07.951955 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8bbf1a6f-b0e4-42b7-9d14-984da0a82176 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:07.960251 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8bbf1a6f-b0e4-42b7-9d14-984da0a82176 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1568 microversion: 2.1 time: 0.162840 May 26 14:04:07.960878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 449/935] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:07 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:08.207442 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-00e77504-4568-48d3-bb64-1394673a01f3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:08.208188 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-00e77504-4568-48d3-bb64-1394673a01f3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:08.215330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-00e77504-4568-48d3-bb64-1394673a01f3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:08.215890 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-00e77504-4568-48d3-bb64-1394673a01f3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:08.216773 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-00e77504-4568-48d3-bb64-1394673a01f3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:08.217831 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-00e77504-4568-48d3-bb64-1394673a01f3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:08.351698 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-00e77504-4568-48d3-bb64-1394673a01f3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:08.360295 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-00e77504-4568-48d3-bb64-1394673a01f3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:08.361929 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-00e77504-4568-48d3-bb64-1394673a01f3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:08.363098 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-00e77504-4568-48d3-bb64-1394673a01f3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1405 microversion: 2.20 time: 0.159728 May 26 14:04:08.363665 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 487/936] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:04:08 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:04:08.977483 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-592d551e-93c0-4a07-a1b2-0e47da225e25 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:08.978096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-592d551e-93c0-4a07-a1b2-0e47da225e25 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:08.980523 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:08.981197 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=10 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:08.987568 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-592d551e-93c0-4a07-a1b2-0e47da225e25 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:08.988026 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-592d551e-93c0-4a07-a1b2-0e47da225e25 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:08.988803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-592d551e-93c0-4a07-a1b2-0e47da225e25 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:08.989270 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-592d551e-93c0-4a07-a1b2-0e47da225e25 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:09.137465 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-592d551e-93c0-4a07-a1b2-0e47da225e25 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:09.145829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-592d551e-93c0-4a07-a1b2-0e47da225e25 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1568 microversion: 2.1 time: 0.172268 May 26 14:04:09.146398 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 450/937] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:08 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:09.381778 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-11191081-193a-41d3-809f-20c7b185dd48 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:09.383048 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-11191081-193a-41d3-809f-20c7b185dd48 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:09.385629 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:09.399348 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-11191081-193a-41d3-809f-20c7b185dd48 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:09.401952 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-11191081-193a-41d3-809f-20c7b185dd48 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:09.403087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-11191081-193a-41d3-809f-20c7b185dd48 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:09.404959 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-11191081-193a-41d3-809f-20c7b185dd48 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:09.626362 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-11191081-193a-41d3-809f-20c7b185dd48 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:09.635394 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-11191081-193a-41d3-809f-20c7b185dd48 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:09.637310 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-11191081-193a-41d3-809f-20c7b185dd48 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:09.638469 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-11191081-193a-41d3-809f-20c7b185dd48 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1405 microversion: 2.20 time: 0.261240 May 26 14:04:09.639627 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 488/938] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:04:09 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1405 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:04:10.163163 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a8418bcb-b50e-4e2c-834b-421d28271669 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:10.163794 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a8418bcb-b50e-4e2c-834b-421d28271669 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:10.171200 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a8418bcb-b50e-4e2c-834b-421d28271669 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:10.171658 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a8418bcb-b50e-4e2c-834b-421d28271669 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:10.172471 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a8418bcb-b50e-4e2c-834b-421d28271669 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:10.172953 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a8418bcb-b50e-4e2c-834b-421d28271669 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:10.310803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a8418bcb-b50e-4e2c-834b-421d28271669 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:10.318578 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a8418bcb-b50e-4e2c-834b-421d28271669 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1568 microversion: 2.1 time: 0.159336 May 26 14:04:10.319150 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 451/939] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:10 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:04:10.660306 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7f46b34e-d16a-49f2-ac75-046fb7b24987 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:10.660996 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7f46b34e-d16a-49f2-ac75-046fb7b24987 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:10.668314 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f46b34e-d16a-49f2-ac75-046fb7b24987 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:10.668904 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f46b34e-d16a-49f2-ac75-046fb7b24987 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:10.670069 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f46b34e-d16a-49f2-ac75-046fb7b24987 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:10.670573 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f46b34e-d16a-49f2-ac75-046fb7b24987 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:10.826781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7f46b34e-d16a-49f2-ac75-046fb7b24987 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:10.835519 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7f46b34e-d16a-49f2-ac75-046fb7b24987 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:10.837180 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7f46b34e-d16a-49f2-ac75-046fb7b24987 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:10.838360 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7f46b34e-d16a-49f2-ac75-046fb7b24987 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1405 microversion: 2.20 time: 0.183455 May 26 14:04:10.838988 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 489/940] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:04:10 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:04:11.335981 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-86ba7764-82f9-4cc1-acd7-e854b84d735f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:11.336697 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-86ba7764-82f9-4cc1-acd7-e854b84d735f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:11.343375 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-86ba7764-82f9-4cc1-acd7-e854b84d735f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:11.343822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-86ba7764-82f9-4cc1-acd7-e854b84d735f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:11.344604 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-86ba7764-82f9-4cc1-acd7-e854b84d735f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:11.345045 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-86ba7764-82f9-4cc1-acd7-e854b84d735f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:11.478262 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-86ba7764-82f9-4cc1-acd7-e854b84d735f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:11.486259 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-86ba7764-82f9-4cc1-acd7-e854b84d735f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1568 microversion: 2.1 time: 0.154201 May 26 14:04:11.486825 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 452/941] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:11 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:11.858400 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d9a8bd2a-3176-4ff0-9ed9-9d545e65b7d5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:11.859310 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d9a8bd2a-3176-4ff0-9ed9-9d545e65b7d5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:11.866387 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d9a8bd2a-3176-4ff0-9ed9-9d545e65b7d5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:11.866877 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d9a8bd2a-3176-4ff0-9ed9-9d545e65b7d5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:11.867720 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d9a8bd2a-3176-4ff0-9ed9-9d545e65b7d5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:11.868260 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d9a8bd2a-3176-4ff0-9ed9-9d545e65b7d5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:11.871103 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:12.035980 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d9a8bd2a-3176-4ff0-9ed9-9d545e65b7d5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:12.044352 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d9a8bd2a-3176-4ff0-9ed9-9d545e65b7d5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:12.046577 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d9a8bd2a-3176-4ff0-9ed9-9d545e65b7d5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:12.047800 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d9a8bd2a-3176-4ff0-9ed9-9d545e65b7d5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1405 microversion: 2.20 time: 0.194474 May 26 14:04:12.048359 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 490/942] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:04:11 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1405 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:04:12.504469 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3ffb59ab-125c-4eda-9f08-fa63aef22ff9 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:12.505097 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3ffb59ab-125c-4eda-9f08-fa63aef22ff9 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:12.511836 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3ffb59ab-125c-4eda-9f08-fa63aef22ff9 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:12.512284 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3ffb59ab-125c-4eda-9f08-fa63aef22ff9 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:12.513081 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3ffb59ab-125c-4eda-9f08-fa63aef22ff9 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:12.514033 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3ffb59ab-125c-4eda-9f08-fa63aef22ff9 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:12.641576 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3ffb59ab-125c-4eda-9f08-fa63aef22ff9 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:12.649237 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3ffb59ab-125c-4eda-9f08-fa63aef22ff9 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1568 microversion: 2.1 time: 0.148827 May 26 14:04:12.649803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 453/943] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:12 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:13.067382 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-39a2dfd8-70b8-4673-9afc-96ca3948b412 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:13.067982 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-39a2dfd8-70b8-4673-9afc-96ca3948b412 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:13.076791 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-39a2dfd8-70b8-4673-9afc-96ca3948b412 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:13.077402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-39a2dfd8-70b8-4673-9afc-96ca3948b412 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:13.078462 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-39a2dfd8-70b8-4673-9afc-96ca3948b412 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:13.079080 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-39a2dfd8-70b8-4673-9afc-96ca3948b412 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:13.219660 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-39a2dfd8-70b8-4673-9afc-96ca3948b412 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:13.227690 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-39a2dfd8-70b8-4673-9afc-96ca3948b412 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:13.229260 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-39a2dfd8-70b8-4673-9afc-96ca3948b412 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:13.230370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-39a2dfd8-70b8-4673-9afc-96ca3948b412 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1405 microversion: 2.20 time: 0.167255 May 26 14:04:13.230939 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 491/944] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:04:13 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:04:13.666493 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bd716db0-f213-49e0-9890-3e1120d7ca7a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:13.667043 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bd716db0-f213-49e0-9890-3e1120d7ca7a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:13.674155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bd716db0-f213-49e0-9890-3e1120d7ca7a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:13.674611 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bd716db0-f213-49e0-9890-3e1120d7ca7a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:13.675379 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bd716db0-f213-49e0-9890-3e1120d7ca7a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:13.675816 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bd716db0-f213-49e0-9890-3e1120d7ca7a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:13.809988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bd716db0-f213-49e0-9890-3e1120d7ca7a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:13.817930 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bd716db0-f213-49e0-9890-3e1120d7ca7a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1568 microversion: 2.1 time: 0.155479 May 26 14:04:13.818528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 454/945] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:13 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:04:14.249388 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-997af723-60a1-49e0-a0e1-f4b0821d64e0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:14.250660 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-997af723-60a1-49e0-a0e1-f4b0821d64e0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:14.256518 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-997af723-60a1-49e0-a0e1-f4b0821d64e0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:14.256973 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-997af723-60a1-49e0-a0e1-f4b0821d64e0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:14.257775 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-997af723-60a1-49e0-a0e1-f4b0821d64e0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:14.258220 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-997af723-60a1-49e0-a0e1-f4b0821d64e0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:14.386237 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-997af723-60a1-49e0-a0e1-f4b0821d64e0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:14.395046 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-997af723-60a1-49e0-a0e1-f4b0821d64e0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:14.396574 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-997af723-60a1-49e0-a0e1-f4b0821d64e0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:14.397704 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-997af723-60a1-49e0-a0e1-f4b0821d64e0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1405 microversion: 2.20 time: 0.152895 May 26 14:04:14.398264 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 492/946] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:04:14 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:04:14.650433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5a3b83ff-737b-47ff-9e5d-b57ce94a5136 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:14.650853 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5a3b83ff-737b-47ff-9e5d-b57ce94a5136 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:14.657189 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5a3b83ff-737b-47ff-9e5d-b57ce94a5136 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:14.657647 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5a3b83ff-737b-47ff-9e5d-b57ce94a5136 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:14.658414 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5a3b83ff-737b-47ff-9e5d-b57ce94a5136 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:14.658856 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5a3b83ff-737b-47ff-9e5d-b57ce94a5136 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:14.683606 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5a3b83ff-737b-47ff-9e5d-b57ce94a5136 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 14:04:14.766599 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5a3b83ff-737b-47ff-9e5d-b57ce94a5136 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "DELETE /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 204 len: 0 microversion: 2.1 time: 0.119750 May 26 14:04:14.767447 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 455/947] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 14:04:14 2022] DELETE /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 14:04:14.775923 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-06bb111e-e634-4c63-8303-61252640565c tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:14.776573 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-06bb111e-e634-4c63-8303-61252640565c tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:14.784463 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-06bb111e-e634-4c63-8303-61252640565c tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:14.784917 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-06bb111e-e634-4c63-8303-61252640565c tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:14.785757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-06bb111e-e634-4c63-8303-61252640565c tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:14.786770 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-06bb111e-e634-4c63-8303-61252640565c tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:14.836271 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2d1d84f6-84d0-4f74-a8c3-5a4d5e37edaf tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:14.837114 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2d1d84f6-84d0-4f74-a8c3-5a4d5e37edaf tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:14.843804 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2d1d84f6-84d0-4f74-a8c3-5a4d5e37edaf tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:14.844252 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2d1d84f6-84d0-4f74-a8c3-5a4d5e37edaf tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:14.845025 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2d1d84f6-84d0-4f74-a8c3-5a4d5e37edaf tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:14.845466 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2d1d84f6-84d0-4f74-a8c3-5a4d5e37edaf tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:14.959651 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-06bb111e-e634-4c63-8303-61252640565c tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:14.968101 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-06bb111e-e634-4c63-8303-61252640565c tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1577 microversion: 2.1 time: 0.196119 May 26 14:04:14.968666 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 493/948] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:14 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1577 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:15.005236 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2d1d84f6-84d0-4f74-a8c3-5a4d5e37edaf tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:15.012895 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2d1d84f6-84d0-4f74-a8c3-5a4d5e37edaf tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1568 microversion: 2.1 time: 0.180883 May 26 14:04:15.013747 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 456/949] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:14 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:04:15.415887 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-375afbf8-81b5-4d13-a765-626b69e53350 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:15.416431 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-375afbf8-81b5-4d13-a765-626b69e53350 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:15.423068 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-375afbf8-81b5-4d13-a765-626b69e53350 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:15.423510 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-375afbf8-81b5-4d13-a765-626b69e53350 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:15.424268 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-375afbf8-81b5-4d13-a765-626b69e53350 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:15.424698 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-375afbf8-81b5-4d13-a765-626b69e53350 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:15.563356 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-375afbf8-81b5-4d13-a765-626b69e53350 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:15.573090 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-375afbf8-81b5-4d13-a765-626b69e53350 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:15.574728 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-375afbf8-81b5-4d13-a765-626b69e53350 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:15.575835 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-375afbf8-81b5-4d13-a765-626b69e53350 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1405 microversion: 2.20 time: 0.164129 May 26 14:04:15.576886 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 494/950] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:04:15 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:04:15.986838 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a5d81f07-2099-44d1-bff8-6cb366395225 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:15.987483 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a5d81f07-2099-44d1-bff8-6cb366395225 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:15.993812 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a5d81f07-2099-44d1-bff8-6cb366395225 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:15.994330 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a5d81f07-2099-44d1-bff8-6cb366395225 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:15.995156 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a5d81f07-2099-44d1-bff8-6cb366395225 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:15.995586 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a5d81f07-2099-44d1-bff8-6cb366395225 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:16.032110 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ecd5341a-84eb-402f-80e5-07452d1dce55 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:16.032751 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ecd5341a-84eb-402f-80e5-07452d1dce55 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:16.039164 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ecd5341a-84eb-402f-80e5-07452d1dce55 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:16.039618 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ecd5341a-84eb-402f-80e5-07452d1dce55 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:16.040405 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ecd5341a-84eb-402f-80e5-07452d1dce55 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:16.040849 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ecd5341a-84eb-402f-80e5-07452d1dce55 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:16.178825 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a5d81f07-2099-44d1-bff8-6cb366395225 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:16.187313 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a5d81f07-2099-44d1-bff8-6cb366395225 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1577 microversion: 2.1 time: 0.205497 May 26 14:04:16.187895 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 457/951] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:15 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1577 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:16.215627 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ecd5341a-84eb-402f-80e5-07452d1dce55 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:16.223173 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ecd5341a-84eb-402f-80e5-07452d1dce55 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1568 microversion: 2.1 time: 0.195114 May 26 14:04:16.223740 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 495/952] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:16 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:16.546666 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-12829b03-add2-4367-94e2-8b12a62f8728 req-cd4eca70-ee6a-48ea-8bc8-6c65e9c00200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7", "name": "network-vif-plugged", "status": "completed", "tag": "703563f0-f1dc-4261-919d-1995757e7da5"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:04:16.554934 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-12829b03-add2-4367-94e2-8b12a62f8728 req-cd4eca70-ee6a-48ea-8bc8-6c65e9c00200 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:16.555384 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-12829b03-add2-4367-94e2-8b12a62f8728 req-cd4eca70-ee6a-48ea-8bc8-6c65e9c00200 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:16.568245 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-12829b03-add2-4367-94e2-8b12a62f8728 req-cd4eca70-ee6a-48ea-8bc8-6c65e9c00200 service nova] Creating event network-vif-plugged:703563f0-f1dc-4261-919d-1995757e7da5 for instance 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 on hv-cinder-84213 May 26 14:04:16.573258 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-12829b03-add2-4367-94e2-8b12a62f8728 req-cd4eca70-ee6a-48ea-8bc8-6c65e9c00200 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030763 May 26 14:04:16.573874 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 458/953] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:04:16.595913 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d99b6a1a-4aaa-4ba0-ae12-72dd6f627b15 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:16.596667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d99b6a1a-4aaa-4ba0-ae12-72dd6f627b15 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:16.603942 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d99b6a1a-4aaa-4ba0-ae12-72dd6f627b15 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:16.604421 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d99b6a1a-4aaa-4ba0-ae12-72dd6f627b15 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:16.605305 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d99b6a1a-4aaa-4ba0-ae12-72dd6f627b15 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:16.605757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d99b6a1a-4aaa-4ba0-ae12-72dd6f627b15 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:16.737798 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d99b6a1a-4aaa-4ba0-ae12-72dd6f627b15 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:16.745817 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d99b6a1a-4aaa-4ba0-ae12-72dd6f627b15 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:16.747301 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d99b6a1a-4aaa-4ba0-ae12-72dd6f627b15 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:16.748417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d99b6a1a-4aaa-4ba0-ae12-72dd6f627b15 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1405 microversion: 2.20 time: 0.158057 May 26 14:04:16.748974 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 496/954] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:04:16 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:04:17.205297 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ff3c1ba0-e441-45e9-b94e-f04ff106fb4e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:17.205992 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ff3c1ba0-e441-45e9-b94e-f04ff106fb4e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:17.212681 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ff3c1ba0-e441-45e9-b94e-f04ff106fb4e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:17.213073 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ff3c1ba0-e441-45e9-b94e-f04ff106fb4e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:17.213889 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ff3c1ba0-e441-45e9-b94e-f04ff106fb4e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:17.214330 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ff3c1ba0-e441-45e9-b94e-f04ff106fb4e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:17.233507 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:17.241462 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4cf10835-ae19-4dbb-831f-20d50e24c9de tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:17.242316 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4cf10835-ae19-4dbb-831f-20d50e24c9de tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:17.250024 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4cf10835-ae19-4dbb-831f-20d50e24c9de tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:17.250582 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4cf10835-ae19-4dbb-831f-20d50e24c9de tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:17.251549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4cf10835-ae19-4dbb-831f-20d50e24c9de tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:17.252091 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4cf10835-ae19-4dbb-831f-20d50e24c9de tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:17.675829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ff3c1ba0-e441-45e9-b94e-f04ff106fb4e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:17.683542 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ff3c1ba0-e441-45e9-b94e-f04ff106fb4e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1577 microversion: 2.1 time: 0.483444 May 26 14:04:17.684122 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 459/955] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:17 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1577 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:17.703907 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4cf10835-ae19-4dbb-831f-20d50e24c9de tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:17.711622 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4cf10835-ae19-4dbb-831f-20d50e24c9de tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1568 microversion: 2.1 time: 0.475406 May 26 14:04:17.712185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 497/956] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:17 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1568 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:04:17.765938 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dab0fe1f-8f98-4ee5-a161-f66a570a63ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:17.766456 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-dab0fe1f-8f98-4ee5-a161-f66a570a63ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:17.772805 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dab0fe1f-8f98-4ee5-a161-f66a570a63ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:17.773281 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dab0fe1f-8f98-4ee5-a161-f66a570a63ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:17.774047 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dab0fe1f-8f98-4ee5-a161-f66a570a63ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:17.774477 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dab0fe1f-8f98-4ee5-a161-f66a570a63ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:17.912928 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dab0fe1f-8f98-4ee5-a161-f66a570a63ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:17.921604 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dab0fe1f-8f98-4ee5-a161-f66a570a63ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:17.923100 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dab0fe1f-8f98-4ee5-a161-f66a570a63ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:17.924197 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dab0fe1f-8f98-4ee5-a161-f66a570a63ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1405 microversion: 2.20 time: 0.162194 May 26 14:04:17.924754 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 460/957] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:04:17 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:04:18.701439 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1ec8f7d0-8f93-4132-a525-92450ab0b212 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:18.702063 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1ec8f7d0-8f93-4132-a525-92450ab0b212 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:18.708743 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1ec8f7d0-8f93-4132-a525-92450ab0b212 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:18.709465 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1ec8f7d0-8f93-4132-a525-92450ab0b212 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:18.709909 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1ec8f7d0-8f93-4132-a525-92450ab0b212 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:18.710346 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1ec8f7d0-8f93-4132-a525-92450ab0b212 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:18.728040 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2631c682-002d-4558-8dbc-bd68e676872a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:18.728916 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2631c682-002d-4558-8dbc-bd68e676872a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:18.735482 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2631c682-002d-4558-8dbc-bd68e676872a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:18.736019 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2631c682-002d-4558-8dbc-bd68e676872a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:18.736813 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2631c682-002d-4558-8dbc-bd68e676872a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:18.737288 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2631c682-002d-4558-8dbc-bd68e676872a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:18.906369 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1ec8f7d0-8f93-4132-a525-92450ab0b212 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:18.914004 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1ec8f7d0-8f93-4132-a525-92450ab0b212 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1577 microversion: 2.1 time: 0.216979 May 26 14:04:18.914589 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 498/958] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:18 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1577 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:18.920652 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2631c682-002d-4558-8dbc-bd68e676872a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:18.928345 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2631c682-002d-4558-8dbc-bd68e676872a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1569 microversion: 2.1 time: 0.204402 May 26 14:04:18.928816 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 461/959] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:18 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1569 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:04:18.942315 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1b9a314d-14ae-4b7f-8d24-4b85433f5467 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:18.943063 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1b9a314d-14ae-4b7f-8d24-4b85433f5467 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:18.944762 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4d9011a9-91c9-4e64-81d7-b74b0248e656 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:04:18.945354 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4d9011a9-91c9-4e64-81d7-b74b0248e656 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:18.949848 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1b9a314d-14ae-4b7f-8d24-4b85433f5467 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:18.950560 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1b9a314d-14ae-4b7f-8d24-4b85433f5467 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:18.951897 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1b9a314d-14ae-4b7f-8d24-4b85433f5467 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:18.952338 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1b9a314d-14ae-4b7f-8d24-4b85433f5467 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:18.952678 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4d9011a9-91c9-4e64-81d7-b74b0248e656 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:18.953222 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4d9011a9-91c9-4e64-81d7-b74b0248e656 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:18.954083 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4d9011a9-91c9-4e64-81d7-b74b0248e656 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:18.954515 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4d9011a9-91c9-4e64-81d7-b74b0248e656 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:19.038560 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4d9011a9-91c9-4e64-81d7-b74b0248e656 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "POST /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7/action" status: 202 len: 0 microversion: 2.1 time: 0.097193 May 26 14:04:19.042213 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 462/960] 10.222.0.91 () {60 vars in 1277 bytes} [Thu May 26 14:04:18 2022] POST /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:04:19.057936 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a284524c-9787-4022-8246-04c6ef7a0d1b tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:19.057936 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a284524c-9787-4022-8246-04c6ef7a0d1b tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:19.071156 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a284524c-9787-4022-8246-04c6ef7a0d1b tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:19.071896 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a284524c-9787-4022-8246-04c6ef7a0d1b tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:19.072852 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a284524c-9787-4022-8246-04c6ef7a0d1b tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:19.073621 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a284524c-9787-4022-8246-04c6ef7a0d1b tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:19.135436 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1b9a314d-14ae-4b7f-8d24-4b85433f5467 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:19.145618 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1b9a314d-14ae-4b7f-8d24-4b85433f5467 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:19.147698 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1b9a314d-14ae-4b7f-8d24-4b85433f5467 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:19.149222 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1b9a314d-14ae-4b7f-8d24-4b85433f5467 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1405 microversion: 2.20 time: 0.210753 May 26 14:04:19.149945 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 499/961] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:04:18 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1405 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:04:19.233255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a284524c-9787-4022-8246-04c6ef7a0d1b tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:19.241069 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a284524c-9787-4022-8246-04c6ef7a0d1b tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1577 microversion: 2.1 time: 0.191302 May 26 14:04:19.241983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 463/962] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:19 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1577 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:04:19.931863 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-287a0f92-343b-4707-bce2-677bfbbc3d76 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:19.932615 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-287a0f92-343b-4707-bce2-677bfbbc3d76 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:19.938977 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-287a0f92-343b-4707-bce2-677bfbbc3d76 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:19.939473 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-287a0f92-343b-4707-bce2-677bfbbc3d76 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:19.940290 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-287a0f92-343b-4707-bce2-677bfbbc3d76 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:19.940687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-287a0f92-343b-4707-bce2-677bfbbc3d76 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:20.080692 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-287a0f92-343b-4707-bce2-677bfbbc3d76 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:20.089723 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-287a0f92-343b-4707-bce2-677bfbbc3d76 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1577 microversion: 2.1 time: 0.161483 May 26 14:04:20.090367 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 500/963] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:19 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:20.167365 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b60030ae-4935-4f74-b313-bf5b79f55b86 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:20.168734 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b60030ae-4935-4f74-b313-bf5b79f55b86 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:20.176002 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b60030ae-4935-4f74-b313-bf5b79f55b86 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:20.176711 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b60030ae-4935-4f74-b313-bf5b79f55b86 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:20.177532 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b60030ae-4935-4f74-b313-bf5b79f55b86 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:20.178128 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b60030ae-4935-4f74-b313-bf5b79f55b86 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:20.260297 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-28c76f0f-5f24-4832-930e-ed548a3804b9 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:20.261228 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-28c76f0f-5f24-4832-930e-ed548a3804b9 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:20.268638 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28c76f0f-5f24-4832-930e-ed548a3804b9 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:20.269380 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28c76f0f-5f24-4832-930e-ed548a3804b9 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:20.270316 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28c76f0f-5f24-4832-930e-ed548a3804b9 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:20.270874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28c76f0f-5f24-4832-930e-ed548a3804b9 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:20.348999 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b60030ae-4935-4f74-b313-bf5b79f55b86 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:20.357329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b60030ae-4935-4f74-b313-bf5b79f55b86 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:20.358857 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b60030ae-4935-4f74-b313-bf5b79f55b86 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:20.359991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b60030ae-4935-4f74-b313-bf5b79f55b86 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1405 microversion: 2.20 time: 0.196639 May 26 14:04:20.360557 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 464/964] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:04:20 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1405 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:04:20.424271 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-28c76f0f-5f24-4832-930e-ed548a3804b9 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:20.435873 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-28c76f0f-5f24-4832-930e-ed548a3804b9 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1517 microversion: 2.1 time: 0.179585 May 26 14:04:20.436463 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 501/965] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:20 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1517 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:04:20.628946 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-c3471630-1731-4c38-ab22-83139cd0732a req-02481640-8037-4a4c-a8cd-d62529be1966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4176fdc7-3ccd-4093-b4c4-841eafb524f7", "name": "network-vif-unplugged", "status": "completed", "tag": "7d604ff9-6337-4905-bd16-e0eb02d19035"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:04:20.639147 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-c3471630-1731-4c38-ab22-83139cd0732a req-02481640-8037-4a4c-a8cd-d62529be1966 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:20.639690 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-c3471630-1731-4c38-ab22-83139cd0732a req-02481640-8037-4a4c-a8cd-d62529be1966 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:20.653456 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.compute.server_external_events [req-c3471630-1731-4c38-ab22-83139cd0732a req-02481640-8037-4a4c-a8cd-d62529be1966 service nova] Unable to find a host for instance 4176fdc7-3ccd-4093-b4c4-841eafb524f7. Dropping event network-vif-unplugged {{(pid=117787) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 14:04:20.654433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-c3471630-1731-4c38-ab22-83139cd0732a req-02481640-8037-4a4c-a8cd-d62529be1966 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030260 May 26 14:04:20.655058 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 465/966] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 26 14:04:21.109450 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c06f097f-1665-49ff-9d5e-e5ee5728903a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:21.110356 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c06f097f-1665-49ff-9d5e-e5ee5728903a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:21.112986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:21.119705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c06f097f-1665-49ff-9d5e-e5ee5728903a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:21.120564 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c06f097f-1665-49ff-9d5e-e5ee5728903a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:21.121640 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c06f097f-1665-49ff-9d5e-e5ee5728903a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:21.122279 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c06f097f-1665-49ff-9d5e-e5ee5728903a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:21.203080 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c06f097f-1665-49ff-9d5e-e5ee5728903a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:21.217739 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c06f097f-1665-49ff-9d5e-e5ee5728903a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1509 microversion: 2.1 time: 0.108597 May 26 14:04:21.217739 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 502/967] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:21 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1509 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:21.281530 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-78bebc08-f275-4ccf-a37e-6bdfdff05f13 req-807192b5-cce0-4e26-9202-9190ac2bd686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3aab00-646f-43d0-bc2c-e376b20d7eed", "name": "network-vif-deleted", "tag": "fdd5f6ec-fca9-44be-abfa-0f0f6fd34c53"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:04:21.303223 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-78bebc08-f275-4ccf-a37e-6bdfdff05f13 req-807192b5-cce0-4e26-9202-9190ac2bd686 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:21.303665 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-78bebc08-f275-4ccf-a37e-6bdfdff05f13 req-807192b5-cce0-4e26-9202-9190ac2bd686 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:21.316696 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-78bebc08-f275-4ccf-a37e-6bdfdff05f13 req-807192b5-cce0-4e26-9202-9190ac2bd686 service nova] Creating event network-vif-deleted:fdd5f6ec-fca9-44be-abfa-0f0f6fd34c53 for instance 5f3aab00-646f-43d0-bc2c-e376b20d7eed on hv-cinder-84213 May 26 14:04:21.322769 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-78bebc08-f275-4ccf-a37e-6bdfdff05f13 req-807192b5-cce0-4e26-9202-9190ac2bd686 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048707 May 26 14:04:21.324056 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 466/968] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:04:21.378262 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-975daa00-5b5f-40f6-8cb3-c99b3f73ebfd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:21.378884 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-975daa00-5b5f-40f6-8cb3-c99b3f73ebfd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:21.385467 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-975daa00-5b5f-40f6-8cb3-c99b3f73ebfd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:21.385939 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-975daa00-5b5f-40f6-8cb3-c99b3f73ebfd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:21.386775 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-975daa00-5b5f-40f6-8cb3-c99b3f73ebfd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:21.387215 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-975daa00-5b5f-40f6-8cb3-c99b3f73ebfd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:21.454735 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b611be99-1791-40de-97c1-4a40c2a4e415 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:21.455845 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b611be99-1791-40de-97c1-4a40c2a4e415 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:21.462734 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b611be99-1791-40de-97c1-4a40c2a4e415 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:21.464028 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b611be99-1791-40de-97c1-4a40c2a4e415 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:21.465679 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b611be99-1791-40de-97c1-4a40c2a4e415 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:21.466143 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b611be99-1791-40de-97c1-4a40c2a4e415 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:21.572156 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-975daa00-5b5f-40f6-8cb3-c99b3f73ebfd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:21.581257 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-975daa00-5b5f-40f6-8cb3-c99b3f73ebfd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:21.582885 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-975daa00-5b5f-40f6-8cb3-c99b3f73ebfd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:21.583949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-975daa00-5b5f-40f6-8cb3-c99b3f73ebfd tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1596 microversion: 2.20 time: 0.209791 May 26 14:04:21.584814 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 503/969] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:04:21 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1596 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:04:21.605957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d4fbe3d9-2753-49bc-92c6-b2e9618234f5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:21.606761 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d4fbe3d9-2753-49bc-92c6-b2e9618234f5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:21.613322 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d4fbe3d9-2753-49bc-92c6-b2e9618234f5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:21.614058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d4fbe3d9-2753-49bc-92c6-b2e9618234f5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:21.614845 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d4fbe3d9-2753-49bc-92c6-b2e9618234f5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:21.615493 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d4fbe3d9-2753-49bc-92c6-b2e9618234f5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:21.646208 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b611be99-1791-40de-97c1-4a40c2a4e415 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:21.654342 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b611be99-1791-40de-97c1-4a40c2a4e415 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1519 microversion: 2.1 time: 0.204881 May 26 14:04:21.655222 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 467/970] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:21 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1519 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:21.700518 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d4fbe3d9-2753-49bc-92c6-b2e9618234f5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098817 May 26 14:04:21.701829 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 504/971] 10.222.0.91 () {60 vars in 1315 bytes} [Thu May 26 14:04:21 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:04:22.233258 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1cbc2848-62e7-4951-aa26-727301b72764 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:22.234024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1cbc2848-62e7-4951-aa26-727301b72764 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:22.244200 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1cbc2848-62e7-4951-aa26-727301b72764 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:22.246044 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1cbc2848-62e7-4951-aa26-727301b72764 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:22.246044 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1cbc2848-62e7-4951-aa26-727301b72764 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:22.246044 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1cbc2848-62e7-4951-aa26-727301b72764 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:22.336905 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1cbc2848-62e7-4951-aa26-727301b72764 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:22.346801 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1cbc2848-62e7-4951-aa26-727301b72764 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1224 microversion: 2.1 time: 0.117404 May 26 14:04:22.356264 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 468/972] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:22 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1224 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:04:22.673065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b36f4817-9567-4459-8540-73e2d165aee8 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:22.673743 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b36f4817-9567-4459-8540-73e2d165aee8 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:22.679826 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b36f4817-9567-4459-8540-73e2d165aee8 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:22.680277 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b36f4817-9567-4459-8540-73e2d165aee8 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:22.681058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b36f4817-9567-4459-8540-73e2d165aee8 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:22.681527 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b36f4817-9567-4459-8540-73e2d165aee8 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:22.814924 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b36f4817-9567-4459-8540-73e2d165aee8 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:22.822638 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b36f4817-9567-4459-8540-73e2d165aee8 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1575 microversion: 2.1 time: 0.154606 May 26 14:04:22.823446 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 505/973] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:22 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:23.353201 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-614c400c-6b8f-4af4-8665-a76de19fdb75 req-0c5f59ce-c02c-4a1c-84d5-09557dfa6032 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7", "tag": "703563f0-f1dc-4261-919d-1995757e7da5"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:04:23.367522 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-dd0a30f8-aa66-473d-a303-a347b3cbbe85 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:23.368143 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-dd0a30f8-aa66-473d-a303-a347b3cbbe85 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:23.373933 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-614c400c-6b8f-4af4-8665-a76de19fdb75 req-0c5f59ce-c02c-4a1c-84d5-09557dfa6032 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:23.374889 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-614c400c-6b8f-4af4-8665-a76de19fdb75 req-0c5f59ce-c02c-4a1c-84d5-09557dfa6032 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:23.377681 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd0a30f8-aa66-473d-a303-a347b3cbbe85 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:23.378416 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd0a30f8-aa66-473d-a303-a347b3cbbe85 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:23.380295 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd0a30f8-aa66-473d-a303-a347b3cbbe85 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:23.380901 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd0a30f8-aa66-473d-a303-a347b3cbbe85 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:23.389932 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-614c400c-6b8f-4af4-8665-a76de19fdb75 req-0c5f59ce-c02c-4a1c-84d5-09557dfa6032 service nova] Creating event network-changed:703563f0-f1dc-4261-919d-1995757e7da5 for instance 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 on hv-cinder-84213 May 26 14:04:23.396645 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-614c400c-6b8f-4af4-8665-a76de19fdb75 req-0c5f59ce-c02c-4a1c-84d5-09557dfa6032 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051188 May 26 14:04:23.401070 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 469/974] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:04:23.431054 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd0a30f8-aa66-473d-a303-a347b3cbbe85 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:23.431830 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd0a30f8-aa66-473d-a303-a347b3cbbe85 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:23.432358 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-dd0a30f8-aa66-473d-a303-a347b3cbbe85 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lazy-loading 'fault' on Instance uuid 5f3aab00-646f-43d0-bc2c-e376b20d7eed {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:04:23.485874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-dd0a30f8-aa66-473d-a303-a347b3cbbe85 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:23.488980 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:23.495272 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-dd0a30f8-aa66-473d-a303-a347b3cbbe85 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 200 len: 1183 microversion: 2.1 time: 0.134661 May 26 14:04:23.501525 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 506/975] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:23 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 1183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:23.840613 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-33dd47df-07dc-49b0-80bd-ca213a44af89 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:23.841875 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-33dd47df-07dc-49b0-80bd-ca213a44af89 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:23.848873 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-33dd47df-07dc-49b0-80bd-ca213a44af89 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:23.849375 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-33dd47df-07dc-49b0-80bd-ca213a44af89 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:23.850180 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-33dd47df-07dc-49b0-80bd-ca213a44af89 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:23.850624 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-33dd47df-07dc-49b0-80bd-ca213a44af89 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:24.003746 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-33dd47df-07dc-49b0-80bd-ca213a44af89 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:24.013017 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-33dd47df-07dc-49b0-80bd-ca213a44af89 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1575 microversion: 2.1 time: 0.176856 May 26 14:04:24.014813 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 470/976] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:23 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:24.519297 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-59004375-f152-4b37-aa67-70978ee69175 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:24.519297 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-59004375-f152-4b37-aa67-70978ee69175 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:24.525124 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-59004375-f152-4b37-aa67-70978ee69175 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:24.525601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-59004375-f152-4b37-aa67-70978ee69175 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:24.526438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-59004375-f152-4b37-aa67-70978ee69175 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:24.526878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-59004375-f152-4b37-aa67-70978ee69175 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:24.544755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-59004375-f152-4b37-aa67-70978ee69175 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] HTTP exception thrown: Instance 5f3aab00-646f-43d0-bc2c-e376b20d7eed could not be found. May 26 14:04:24.546370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-59004375-f152-4b37-aa67-70978ee69175 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Request method failure captured: May 26 14:04:24.546370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed HTTP/1.1 May 26 14:04:24.546370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 14:04:24.546370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 14:04:24.546370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 14:04:24.546370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 14:04:24.546370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 14:04:24.546370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 14:04:24.546370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 14:04:24.546370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 14:04:24.546370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4fQEMorT2ibWX8DnqTCd00KeH3g2Pvquv96fAcwf52AY4-8QDs9eEXQntJ4WS1usPhd7zMTjmNb8C5wSbIe0llpMQRt0GQtvObIQk2nSYK7EaP78sjQCzcOWlqlnC54UR_-Woky_khat3-5OxmdrQRD-dheNUsLdYAjZNcC-V6W5Fk May 26 14:04:24.546370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 14:04:24.546370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 14:04:24.546370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 14:04:24.546370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 14:04:24.546370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 14:04:24.546370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 14:04:24.546370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: ed15631acafd41528b96f2ed12c19e5b May 26 14:04:24.546370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-TestVolumeBootPattern-1658933058 May 26 14:04:24.546370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 14:04:24.546370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 14:04:24.547757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ed15631acafd41528b96f2ed12c19e5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ed15631acafd41528b96f2ed12c19e5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/ed15631acafd41528b96f2ed12c19e5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_ed15631acafd41528b96f2ed12c19e5b", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:04:24.547757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-TestVolumeBootPattern-1658933058 May 26 14:04:24.547757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: ed15631acafd41528b96f2ed12c19e5b May 26 14:04:24.547757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-TestVolumeBootPattern-1658933058 May 26 14:04:24.547757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-TestVolumeBootPattern-1658933058-project May 26 14:04:24.547757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 14:04:24.547757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 14:04:24.547757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: 5068f06b1a8e47b88ba3294169545aa3 May 26 14:04:24.547757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-TestVolumeBootPattern-1658933058-project May 26 14:04:24.547757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 14:04:24.547757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Instance 5f3aab00-646f-43d0-bc2c-e376b20d7eed could not be found. May 26 14:04:24.547757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': '5f3aab00-646f-43d0-bc2c-e376b20d7eed'} May 26 14:04:24.548958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:04:24.548958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:04:24.548958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:04:24.548958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:04:24.548958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:04:24.548958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:04:24.548958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:04:24.548958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:04:24.548958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:04:24.548958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:04:24.548958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f3aab00-646f-43d0-bc2c-e376b20d7eed could not be found. May 26 14:04:24.548958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:04:24.548958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:04:24.548958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:04:24.548958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:04:24.548958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:04:24.548958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:04:24.548958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:04:24.548958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:04:24.548958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:04:24.550384 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:04:24.550384 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:04:24.550384 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:04:24.550384 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:04:24.550384 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:04:24.550384 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:04:24.550384 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:04:24.550384 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f3aab00-646f-43d0-bc2c-e376b20d7eed could not be found. May 26 14:04:24.550384 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:04:24.550384 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:04:24.550384 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:04:24.550384 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:04:24.550384 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:04:24.550384 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:04:24.550384 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:04:24.550384 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:04:24.550384 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f3aab00-646f-43d0-bc2c-e376b20d7eed could not be found. May 26 14:04:24.550384 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:04:24.551480 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-59004375-f152-4b37-aa67-70978ee69175 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Returning 404 to user: Instance 5f3aab00-646f-43d0-bc2c-e376b20d7eed could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:04:24.551480 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-59004375-f152-4b37-aa67-70978ee69175 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 404 len: 111 microversion: 2.1 time: 0.035008 May 26 14:04:24.551480 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 507/977] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:24 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:04:24.706154 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8d892f93-e321-427d-af9b-3685b0fe3686 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-163086729", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-886850747", "security_groups": [{"name": "tempest-secgroup-smoke-1274687408"}], "block_device_mapping_v2": [{"uuid": "01c79ff6-ce9e-4a3f-bbf7-9a1fc154dbf3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bb3bf56d-90fc-4a74-995d-ab2752db975c"}]}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:04:24.819219 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-8d892f93-e321-427d-af9b-3685b0fe3686 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] validate_networks() for [('bb3bf56d-90fc-4a74-995d-ab2752db975c', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 14:04:25.031020 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a51d2cfa-d731-46c6-8bf8-f031065b0290 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:25.031631 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a51d2cfa-d731-46c6-8bf8-f031065b0290 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:25.037639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a51d2cfa-d731-46c6-8bf8-f031065b0290 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:25.038082 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a51d2cfa-d731-46c6-8bf8-f031065b0290 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:25.038843 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a51d2cfa-d731-46c6-8bf8-f031065b0290 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:25.039276 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a51d2cfa-d731-46c6-8bf8-f031065b0290 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:25.246163 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a51d2cfa-d731-46c6-8bf8-f031065b0290 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:25.253531 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a51d2cfa-d731-46c6-8bf8-f031065b0290 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1575 microversion: 2.1 time: 0.226523 May 26 14:04:25.254099 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 508/978] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:25 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1575 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:04:25.267335 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-8d892f93-e321-427d-af9b-3685b0fe3686 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 14:04:25.267761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-8d892f93-e321-427d-af9b-3685b0fe3686 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 14:04:25.268230 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-8d892f93-e321-427d-af9b-3685b0fe3686 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 14:04:25.268635 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-8d892f93-e321-427d-af9b-3685b0fe3686 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 14:04:25.269042 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-8d892f93-e321-427d-af9b-3685b0fe3686 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 14:04:25.277845 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8d892f93-e321-427d-af9b-3685b0fe3686 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:25.278291 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8d892f93-e321-427d-af9b-3685b0fe3686 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:25.279661 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8d892f93-e321-427d-af9b-3685b0fe3686 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:25.280096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8d892f93-e321-427d-af9b-3685b0fe3686 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:25.296537 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-8d892f93-e321-427d-af9b-3685b0fe3686 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Getting quotas for project ed15631acafd41528b96f2ed12c19e5b. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 14:04:25.300528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-8d892f93-e321-427d-af9b-3685b0fe3686 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Getting quotas for user 5068f06b1a8e47b88ba3294169545aa3 and project ed15631acafd41528b96f2ed12c19e5b. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 14:04:25.302870 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:25.363226 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8d892f93-e321-427d-af9b-3685b0fe3686 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 14:04:25.365360 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8d892f93-e321-427d-af9b-3685b0fe3686 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: e68d6609-e48d-4d4d-8327-48fbf40b6ebd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='01c79ff6-ce9e-4a3f-bbf7-9a1fc154dbf3',volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 14:04:25.489961 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8d892f93-e321-427d-af9b-3685b0fe3686 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.787603 May 26 14:04:25.490523 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 471/979] 10.222.0.91 () {60 vars in 1146 bytes} [Thu May 26 14:04:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 14:04:25.500887 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-75412d70-d14d-49e7-95af-e1abac0a843a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:25.501530 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-75412d70-d14d-49e7-95af-e1abac0a843a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: e68d6609-e48d-4d4d-8327-48fbf40b6ebd] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:25.554148 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-75412d70-d14d-49e7-95af-e1abac0a843a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:25.561334 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-75412d70-d14d-49e7-95af-e1abac0a843a tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd" status: 200 len: 1093 microversion: 2.1 time: 0.064781 May 26 14:04:25.561897 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 509/980] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:25 2022] GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:26.271422 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9c853195-d2f9-44de-a9d2-7a51a6b96279 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:26.271962 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9c853195-d2f9-44de-a9d2-7a51a6b96279 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:26.278403 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9c853195-d2f9-44de-a9d2-7a51a6b96279 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:26.279339 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9c853195-d2f9-44de-a9d2-7a51a6b96279 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:26.280230 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9c853195-d2f9-44de-a9d2-7a51a6b96279 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:26.280701 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9c853195-d2f9-44de-a9d2-7a51a6b96279 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:26.412228 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9c853195-d2f9-44de-a9d2-7a51a6b96279 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:26.420562 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9c853195-d2f9-44de-a9d2-7a51a6b96279 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1575 microversion: 2.1 time: 0.153207 May 26 14:04:26.421232 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 472/981] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:26 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:26.579594 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-27eb3811-e111-4e5f-976b-815b82f0d201 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:26.580321 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-27eb3811-e111-4e5f-976b-815b82f0d201 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: e68d6609-e48d-4d4d-8327-48fbf40b6ebd] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:26.590458 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27eb3811-e111-4e5f-976b-815b82f0d201 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:26.590929 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27eb3811-e111-4e5f-976b-815b82f0d201 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:26.592433 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27eb3811-e111-4e5f-976b-815b82f0d201 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:26.592869 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27eb3811-e111-4e5f-976b-815b82f0d201 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:26.661073 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-27eb3811-e111-4e5f-976b-815b82f0d201 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:26.668662 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-27eb3811-e111-4e5f-976b-815b82f0d201 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd" status: 200 len: 1209 microversion: 2.1 time: 0.093673 May 26 14:04:26.669247 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 510/982] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:26 2022] GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd => generated 1209 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:04:27.439038 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3d270b3c-2f3e-49ec-91fc-d20faf939f7b tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:27.440936 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3d270b3c-2f3e-49ec-91fc-d20faf939f7b tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:27.455916 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3d270b3c-2f3e-49ec-91fc-d20faf939f7b tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:27.456641 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3d270b3c-2f3e-49ec-91fc-d20faf939f7b tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:27.457773 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3d270b3c-2f3e-49ec-91fc-d20faf939f7b tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:27.458563 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3d270b3c-2f3e-49ec-91fc-d20faf939f7b tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:27.659105 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3d270b3c-2f3e-49ec-91fc-d20faf939f7b tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:27.667386 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3d270b3c-2f3e-49ec-91fc-d20faf939f7b tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1575 microversion: 2.1 time: 0.233548 May 26 14:04:27.668321 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 473/983] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:27 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1575 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:27.687812 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5e0aab23-f1ba-4027-a6e8-a8baab598962 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:27.688394 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5e0aab23-f1ba-4027-a6e8-a8baab598962 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: e68d6609-e48d-4d4d-8327-48fbf40b6ebd] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:27.698181 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5e0aab23-f1ba-4027-a6e8-a8baab598962 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:27.699091 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5e0aab23-f1ba-4027-a6e8-a8baab598962 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:27.699894 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5e0aab23-f1ba-4027-a6e8-a8baab598962 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:27.700337 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5e0aab23-f1ba-4027-a6e8-a8baab598962 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:27.860244 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5e0aab23-f1ba-4027-a6e8-a8baab598962 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:27.868734 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5e0aab23-f1ba-4027-a6e8-a8baab598962 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd" status: 200 len: 1265 microversion: 2.1 time: 0.185315 May 26 14:04:27.869345 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 511/984] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:27 2022] GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:04:28.537211 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-3c9d4a29-0bf6-4a3e-8352-bc595790ccdc req-512c3062-0b59-4a8f-a564-d6f6083e96dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e68d6609-e48d-4d4d-8327-48fbf40b6ebd", "tag": "caf319b9-9a28-4413-9e5b-84e2d576651e"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:04:28.548677 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-3c9d4a29-0bf6-4a3e-8352-bc595790ccdc req-512c3062-0b59-4a8f-a564-d6f6083e96dc service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:28.553992 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-3c9d4a29-0bf6-4a3e-8352-bc595790ccdc req-512c3062-0b59-4a8f-a564-d6f6083e96dc service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:28.576932 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-3c9d4a29-0bf6-4a3e-8352-bc595790ccdc req-512c3062-0b59-4a8f-a564-d6f6083e96dc service nova] Creating event network-changed:caf319b9-9a28-4413-9e5b-84e2d576651e for instance e68d6609-e48d-4d4d-8327-48fbf40b6ebd on hv-cinder-84213 May 26 14:04:28.583320 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-3c9d4a29-0bf6-4a3e-8352-bc595790ccdc req-512c3062-0b59-4a8f-a564-d6f6083e96dc service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049931 May 26 14:04:28.584875 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 474/985] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:04:28.688177 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-72f68b17-ccd9-433c-b85e-6aa9f0a48254 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:28.689669 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-72f68b17-ccd9-433c-b85e-6aa9f0a48254 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:28.697452 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-72f68b17-ccd9-433c-b85e-6aa9f0a48254 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:28.697912 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-72f68b17-ccd9-433c-b85e-6aa9f0a48254 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:28.698697 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-72f68b17-ccd9-433c-b85e-6aa9f0a48254 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:28.699135 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-72f68b17-ccd9-433c-b85e-6aa9f0a48254 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:28.832073 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-72f68b17-ccd9-433c-b85e-6aa9f0a48254 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:28.839675 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-72f68b17-ccd9-433c-b85e-6aa9f0a48254 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1575 microversion: 2.1 time: 0.155869 May 26 14:04:28.840574 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 512/986] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:28 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:28.892301 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-04a2df96-6091-4f06-8e42-872a99df0e17 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:28.893027 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-04a2df96-6091-4f06-8e42-872a99df0e17 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: e68d6609-e48d-4d4d-8327-48fbf40b6ebd] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:28.900785 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-04a2df96-6091-4f06-8e42-872a99df0e17 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:28.901616 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-04a2df96-6091-4f06-8e42-872a99df0e17 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:28.903005 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-04a2df96-6091-4f06-8e42-872a99df0e17 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:28.903835 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-04a2df96-6091-4f06-8e42-872a99df0e17 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:29.040557 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-04a2df96-6091-4f06-8e42-872a99df0e17 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:29.049655 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-04a2df96-6091-4f06-8e42-872a99df0e17 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd" status: 200 len: 1265 microversion: 2.1 time: 0.164190 May 26 14:04:29.050253 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 475/987] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:28 2022] GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:29.858056 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a6f9a3cc-b8be-420d-ac93-0c46e609f126 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:29.858615 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a6f9a3cc-b8be-420d-ac93-0c46e609f126 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:29.864948 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a6f9a3cc-b8be-420d-ac93-0c46e609f126 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:29.865486 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a6f9a3cc-b8be-420d-ac93-0c46e609f126 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:29.866239 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a6f9a3cc-b8be-420d-ac93-0c46e609f126 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:29.866668 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a6f9a3cc-b8be-420d-ac93-0c46e609f126 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:29.996398 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a6f9a3cc-b8be-420d-ac93-0c46e609f126 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:30.003916 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a6f9a3cc-b8be-420d-ac93-0c46e609f126 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1575 microversion: 2.1 time: 0.150503 May 26 14:04:30.004478 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 513/988] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:29 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:30.066649 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-defd4c53-690b-438c-8842-2439bdf04749 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:30.067365 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-defd4c53-690b-438c-8842-2439bdf04749 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: e68d6609-e48d-4d4d-8327-48fbf40b6ebd] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:30.073906 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-defd4c53-690b-438c-8842-2439bdf04749 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:30.074456 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-defd4c53-690b-438c-8842-2439bdf04749 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:30.075233 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-defd4c53-690b-438c-8842-2439bdf04749 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:30.075673 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-defd4c53-690b-438c-8842-2439bdf04749 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:30.215674 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-defd4c53-690b-438c-8842-2439bdf04749 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:30.226839 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-defd4c53-690b-438c-8842-2439bdf04749 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd" status: 200 len: 1265 microversion: 2.1 time: 0.163998 May 26 14:04:30.227504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 476/989] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:30 2022] GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:31.020765 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7c6da75e-df95-4e6e-96dd-3979560286d5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:31.021430 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7c6da75e-df95-4e6e-96dd-3979560286d5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:31.027909 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7c6da75e-df95-4e6e-96dd-3979560286d5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:31.028360 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7c6da75e-df95-4e6e-96dd-3979560286d5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:31.029781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7c6da75e-df95-4e6e-96dd-3979560286d5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:31.030224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7c6da75e-df95-4e6e-96dd-3979560286d5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:31.158504 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7c6da75e-df95-4e6e-96dd-3979560286d5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:31.166569 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7c6da75e-df95-4e6e-96dd-3979560286d5 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1575 microversion: 2.1 time: 0.150007 May 26 14:04:31.167139 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 514/990] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:31 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:31.253910 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0430eedf-6b70-45f4-bd0e-983ab74f5b36 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:31.254452 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0430eedf-6b70-45f4-bd0e-983ab74f5b36 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: e68d6609-e48d-4d4d-8327-48fbf40b6ebd] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:31.260838 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0430eedf-6b70-45f4-bd0e-983ab74f5b36 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:31.261314 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0430eedf-6b70-45f4-bd0e-983ab74f5b36 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:31.262074 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0430eedf-6b70-45f4-bd0e-983ab74f5b36 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:31.262509 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0430eedf-6b70-45f4-bd0e-983ab74f5b36 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:31.393298 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0430eedf-6b70-45f4-bd0e-983ab74f5b36 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:31.400626 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0430eedf-6b70-45f4-bd0e-983ab74f5b36 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd" status: 200 len: 1265 microversion: 2.1 time: 0.150620 May 26 14:04:31.401200 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 477/991] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:31 2022] GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:32.187031 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f0f22c61-57d2-4322-a2b7-a008daf9d3d9 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:32.187696 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f0f22c61-57d2-4322-a2b7-a008daf9d3d9 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:32.194428 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f0f22c61-57d2-4322-a2b7-a008daf9d3d9 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:32.194881 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f0f22c61-57d2-4322-a2b7-a008daf9d3d9 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:32.196031 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f0f22c61-57d2-4322-a2b7-a008daf9d3d9 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:32.196121 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f0f22c61-57d2-4322-a2b7-a008daf9d3d9 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:32.328448 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f0f22c61-57d2-4322-a2b7-a008daf9d3d9 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:32.336063 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f0f22c61-57d2-4322-a2b7-a008daf9d3d9 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1575 microversion: 2.1 time: 0.156150 May 26 14:04:32.336633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 515/992] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:32 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:32.416839 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-10ee93b0-2918-4919-98be-4f82065689e6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:32.417484 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-10ee93b0-2918-4919-98be-4f82065689e6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: e68d6609-e48d-4d4d-8327-48fbf40b6ebd] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:32.424115 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-10ee93b0-2918-4919-98be-4f82065689e6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:32.424560 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-10ee93b0-2918-4919-98be-4f82065689e6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:32.425347 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-10ee93b0-2918-4919-98be-4f82065689e6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:32.425781 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-10ee93b0-2918-4919-98be-4f82065689e6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:32.444422 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:32.556121 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-10ee93b0-2918-4919-98be-4f82065689e6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:32.564232 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-10ee93b0-2918-4919-98be-4f82065689e6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd" status: 200 len: 1265 microversion: 2.1 time: 0.151219 May 26 14:04:32.564798 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 478/993] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:32 2022] GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:33.353038 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f882873a-1079-462f-bf6f-bbe6bb3f143c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:33.353616 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f882873a-1079-462f-bf6f-bbe6bb3f143c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:33.360651 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f882873a-1079-462f-bf6f-bbe6bb3f143c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:33.361102 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f882873a-1079-462f-bf6f-bbe6bb3f143c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:33.361898 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f882873a-1079-462f-bf6f-bbe6bb3f143c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:33.362338 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f882873a-1079-462f-bf6f-bbe6bb3f143c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:33.495914 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f882873a-1079-462f-bf6f-bbe6bb3f143c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:33.504074 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f882873a-1079-462f-bf6f-bbe6bb3f143c tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1575 microversion: 2.1 time: 0.155294 May 26 14:04:33.504643 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 516/994] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:33 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:33.581392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-62646e57-b672-456e-8796-e6bdc832073f tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:33.582012 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-62646e57-b672-456e-8796-e6bdc832073f tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: e68d6609-e48d-4d4d-8327-48fbf40b6ebd] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:33.588403 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-62646e57-b672-456e-8796-e6bdc832073f tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:33.588845 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-62646e57-b672-456e-8796-e6bdc832073f tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:33.589615 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-62646e57-b672-456e-8796-e6bdc832073f tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:33.590047 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-62646e57-b672-456e-8796-e6bdc832073f tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:33.718357 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-62646e57-b672-456e-8796-e6bdc832073f tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:33.725781 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-62646e57-b672-456e-8796-e6bdc832073f tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd" status: 200 len: 1265 microversion: 2.1 time: 0.148200 May 26 14:04:33.726349 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 479/995] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:33 2022] GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:34.521828 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fac2e7f1-2aa5-4413-b65f-3617f8709ab2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:34.522447 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fac2e7f1-2aa5-4413-b65f-3617f8709ab2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:34.529193 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fac2e7f1-2aa5-4413-b65f-3617f8709ab2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:34.529638 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fac2e7f1-2aa5-4413-b65f-3617f8709ab2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:34.530422 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fac2e7f1-2aa5-4413-b65f-3617f8709ab2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:34.530861 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fac2e7f1-2aa5-4413-b65f-3617f8709ab2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:34.673434 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fac2e7f1-2aa5-4413-b65f-3617f8709ab2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:34.676826 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7dd90b27-1f08-473d-b0a2-884e9247a73b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:34.677999 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7dd90b27-1f08-473d-b0a2-884e9247a73b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:34.681330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fac2e7f1-2aa5-4413-b65f-3617f8709ab2 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1575 microversion: 2.1 time: 0.163527 May 26 14:04:34.682154 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 517/996] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:34 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:04:34.686311 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7dd90b27-1f08-473d-b0a2-884e9247a73b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:34.686972 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7dd90b27-1f08-473d-b0a2-884e9247a73b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:34.687976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7dd90b27-1f08-473d-b0a2-884e9247a73b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:34.688513 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7dd90b27-1f08-473d-b0a2-884e9247a73b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:34.743202 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b3eddc7d-b9a4-4e49-b1cd-c9cc6e0c30d7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:34.743942 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b3eddc7d-b9a4-4e49-b1cd-c9cc6e0c30d7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: e68d6609-e48d-4d4d-8327-48fbf40b6ebd] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:34.751067 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b3eddc7d-b9a4-4e49-b1cd-c9cc6e0c30d7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:34.751582 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b3eddc7d-b9a4-4e49-b1cd-c9cc6e0c30d7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:34.752439 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b3eddc7d-b9a4-4e49-b1cd-c9cc6e0c30d7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:34.752923 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b3eddc7d-b9a4-4e49-b1cd-c9cc6e0c30d7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:34.779954 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-7dd90b27-1f08-473d-b0a2-884e9247a73b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lazy-loading 'services' on Instance uuid aa89e8ed-11d3-42d2-b030-5b7497694471 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:04:34.859371 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7dd90b27-1f08-473d-b0a2-884e9247a73b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "DELETE /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471/os-volume_attachments/48cefb20-0ef9-47ec-8225-5d5a822f9b62" status: 202 len: 0 microversion: 2.1 time: 0.186858 May 26 14:04:34.860340 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 480/997] 10.222.0.91 () {58 vars in 1415 bytes} [Thu May 26 14:04:34 2022] DELETE /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471/os-volume_attachments/48cefb20-0ef9-47ec-8225-5d5a822f9b62 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:04:34.870410 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8600a9ab-0988-4104-8c97-65419eea97a0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:34.871551 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8600a9ab-0988-4104-8c97-65419eea97a0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:34.879311 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8600a9ab-0988-4104-8c97-65419eea97a0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:34.880045 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8600a9ab-0988-4104-8c97-65419eea97a0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:34.881249 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8600a9ab-0988-4104-8c97-65419eea97a0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:34.881695 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8600a9ab-0988-4104-8c97-65419eea97a0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:34.900788 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b3eddc7d-b9a4-4e49-b1cd-c9cc6e0c30d7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:34.909079 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b3eddc7d-b9a4-4e49-b1cd-c9cc6e0c30d7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd" status: 200 len: 1265 microversion: 2.1 time: 0.169672 May 26 14:04:34.910265 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 518/998] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:34 2022] GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:04:34.915414 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8600a9ab-0988-4104-8c97-65419eea97a0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050698 May 26 14:04:34.916060 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 481/999] 10.222.0.91 () {58 vars in 1301 bytes} [Thu May 26 14:04:34 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:04:35.699503 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-75f42c8c-9eca-422f-8a42-fd8eb0339eac tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:35.700117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-75f42c8c-9eca-422f-8a42-fd8eb0339eac tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:35.702482 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:35.707898 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-75f42c8c-9eca-422f-8a42-fd8eb0339eac tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:35.708352 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-75f42c8c-9eca-422f-8a42-fd8eb0339eac tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:35.709126 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-75f42c8c-9eca-422f-8a42-fd8eb0339eac tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:35.709592 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-75f42c8c-9eca-422f-8a42-fd8eb0339eac tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:35.838137 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-75f42c8c-9eca-422f-8a42-fd8eb0339eac tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:35.846082 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-75f42c8c-9eca-422f-8a42-fd8eb0339eac tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1575 microversion: 2.1 time: 0.150548 May 26 14:04:35.846649 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 519/1000] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:35 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:35.927049 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f061685e-b36c-4a08-aad5-21a16848ec70 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:35.927259 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1bd3e199-bf4a-494d-8680-9706fe39d94a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:35.927703 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f061685e-b36c-4a08-aad5-21a16848ec70 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: e68d6609-e48d-4d4d-8327-48fbf40b6ebd] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:35.927990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1bd3e199-bf4a-494d-8680-9706fe39d94a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:35.929951 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:35.930770 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=6 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:35.933748 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f061685e-b36c-4a08-aad5-21a16848ec70 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:35.934197 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f061685e-b36c-4a08-aad5-21a16848ec70 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:35.934976 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f061685e-b36c-4a08-aad5-21a16848ec70 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:35.935405 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f061685e-b36c-4a08-aad5-21a16848ec70 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:35.937851 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1bd3e199-bf4a-494d-8680-9706fe39d94a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:35.938306 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1bd3e199-bf4a-494d-8680-9706fe39d94a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:35.939231 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1bd3e199-bf4a-494d-8680-9706fe39d94a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:35.939532 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1bd3e199-bf4a-494d-8680-9706fe39d94a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:35.969038 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1bd3e199-bf4a-494d-8680-9706fe39d94a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045797 May 26 14:04:35.969644 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 482/1001] 10.222.0.91 () {58 vars in 1301 bytes} [Thu May 26 14:04:35 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:04:36.067797 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f061685e-b36c-4a08-aad5-21a16848ec70 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:36.075278 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f061685e-b36c-4a08-aad5-21a16848ec70 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd" status: 200 len: 1265 microversion: 2.1 time: 0.152137 May 26 14:04:36.075851 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 520/1002] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:35 2022] GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:36.682509 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-233e5a88-2e2e-4f6b-8cf3-1e1f1714264a req-91fe0504-e9d5-485f-8230-738f495d8f06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4176fdc7-3ccd-4093-b4c4-841eafb524f7", "name": "network-vif-plugged", "status": "completed", "tag": "7d604ff9-6337-4905-bd16-e0eb02d19035"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:04:36.693401 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-233e5a88-2e2e-4f6b-8cf3-1e1f1714264a req-91fe0504-e9d5-485f-8230-738f495d8f06 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:36.708239 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-233e5a88-2e2e-4f6b-8cf3-1e1f1714264a req-91fe0504-e9d5-485f-8230-738f495d8f06 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:36.720669 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-233e5a88-2e2e-4f6b-8cf3-1e1f1714264a req-91fe0504-e9d5-485f-8230-738f495d8f06 service nova] Creating event network-vif-plugged:7d604ff9-6337-4905-bd16-e0eb02d19035 for instance 4176fdc7-3ccd-4093-b4c4-841eafb524f7 on hv-cinder-84213 May 26 14:04:36.725560 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-233e5a88-2e2e-4f6b-8cf3-1e1f1714264a req-91fe0504-e9d5-485f-8230-738f495d8f06 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047426 May 26 14:04:36.726150 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 483/1003] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:04:36.863230 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1265be6a-5c2e-4837-9479-67e81a094994 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:36.863751 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1265be6a-5c2e-4837-9479-67e81a094994 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:36.870226 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1265be6a-5c2e-4837-9479-67e81a094994 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:36.870675 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1265be6a-5c2e-4837-9479-67e81a094994 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:36.871437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1265be6a-5c2e-4837-9479-67e81a094994 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:36.871870 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1265be6a-5c2e-4837-9479-67e81a094994 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:36.982794 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-df8cf84f-09e9-43aa-af13-9814ad845480 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:36.983889 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-df8cf84f-09e9-43aa-af13-9814ad845480 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:36.990886 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-df8cf84f-09e9-43aa-af13-9814ad845480 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:36.991338 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-df8cf84f-09e9-43aa-af13-9814ad845480 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:36.992103 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-df8cf84f-09e9-43aa-af13-9814ad845480 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:36.992542 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-df8cf84f-09e9-43aa-af13-9814ad845480 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:37.004502 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1265be6a-5c2e-4837-9479-67e81a094994 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:37.012002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1265be6a-5c2e-4837-9479-67e81a094994 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1575 microversion: 2.1 time: 0.152641 May 26 14:04:37.012617 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 521/1004] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:36 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:37.022811 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-df8cf84f-09e9-43aa-af13-9814ad845480 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046525 May 26 14:04:37.023369 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 484/1005] 10.222.0.91 () {58 vars in 1301 bytes} [Thu May 26 14:04:36 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:04:37.092740 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b56b7683-987f-4162-9d6c-f70862732c89 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:37.093407 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b56b7683-987f-4162-9d6c-f70862732c89 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: e68d6609-e48d-4d4d-8327-48fbf40b6ebd] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:37.099916 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b56b7683-987f-4162-9d6c-f70862732c89 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:37.100365 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b56b7683-987f-4162-9d6c-f70862732c89 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:37.101140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b56b7683-987f-4162-9d6c-f70862732c89 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:37.101601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b56b7683-987f-4162-9d6c-f70862732c89 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:37.241505 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b56b7683-987f-4162-9d6c-f70862732c89 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:37.251481 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b56b7683-987f-4162-9d6c-f70862732c89 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd" status: 200 len: 1265 microversion: 2.1 time: 0.163045 May 26 14:04:37.252050 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 522/1006] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:37 2022] GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:38.029519 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8cd40fa0-5d0f-41de-b3c6-d0c5083ce925 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:38.030101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8cd40fa0-5d0f-41de-b3c6-d0c5083ce925 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:38.034784 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-827eefbb-641c-45f4-9afc-7976ee62bad5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:38.035790 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-827eefbb-641c-45f4-9afc-7976ee62bad5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:38.036228 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8cd40fa0-5d0f-41de-b3c6-d0c5083ce925 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:38.036685 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8cd40fa0-5d0f-41de-b3c6-d0c5083ce925 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:38.037489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8cd40fa0-5d0f-41de-b3c6-d0c5083ce925 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:38.041784 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8cd40fa0-5d0f-41de-b3c6-d0c5083ce925 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:38.042322 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-827eefbb-641c-45f4-9afc-7976ee62bad5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:38.042770 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-827eefbb-641c-45f4-9afc-7976ee62bad5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:38.043543 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-827eefbb-641c-45f4-9afc-7976ee62bad5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:38.043976 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-827eefbb-641c-45f4-9afc-7976ee62bad5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:38.074100 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-827eefbb-641c-45f4-9afc-7976ee62bad5 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043148 May 26 14:04:38.074726 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 523/1007] 10.222.0.91 () {58 vars in 1301 bytes} [Thu May 26 14:04:38 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 14:04:38.153663 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-00911a32-0029-4e49-9df4-de8e089620a1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:38.154166 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-00911a32-0029-4e49-9df4-de8e089620a1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:38.160168 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-00911a32-0029-4e49-9df4-de8e089620a1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:38.160618 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-00911a32-0029-4e49-9df4-de8e089620a1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:38.161421 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-00911a32-0029-4e49-9df4-de8e089620a1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:38.161858 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-00911a32-0029-4e49-9df4-de8e089620a1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:38.187201 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-00911a32-0029-4e49-9df4-de8e089620a1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 14:04:38.187602 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8cd40fa0-5d0f-41de-b3c6-d0c5083ce925 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:38.196687 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8cd40fa0-5d0f-41de-b3c6-d0c5083ce925 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1575 microversion: 2.1 time: 0.171992 May 26 14:04:38.197290 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 485/1008] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:38 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:38.203158 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:38.261692 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-00911a32-0029-4e49-9df4-de8e089620a1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "DELETE /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 204 len: 0 microversion: 2.1 time: 0.111583 May 26 14:04:38.262271 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 524/1009] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 14:04:38 2022] DELETE /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 14:04:38.270046 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2f65feea-59b4-421c-b5da-ec2a5bce4380 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:38.270670 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2f65feea-59b4-421c-b5da-ec2a5bce4380 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: e68d6609-e48d-4d4d-8327-48fbf40b6ebd] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:38.273996 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-310f1168-585c-4efb-b7dd-407714958a1a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:38.274713 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-310f1168-585c-4efb-b7dd-407714958a1a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:38.276769 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2f65feea-59b4-421c-b5da-ec2a5bce4380 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:38.277285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2f65feea-59b4-421c-b5da-ec2a5bce4380 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:38.278235 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2f65feea-59b4-421c-b5da-ec2a5bce4380 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:38.278706 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2f65feea-59b4-421c-b5da-ec2a5bce4380 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:38.281064 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-310f1168-585c-4efb-b7dd-407714958a1a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:38.281609 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-310f1168-585c-4efb-b7dd-407714958a1a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:38.283831 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-310f1168-585c-4efb-b7dd-407714958a1a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:38.283831 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-310f1168-585c-4efb-b7dd-407714958a1a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:38.463003 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2f65feea-59b4-421c-b5da-ec2a5bce4380 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:38.470936 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2f65feea-59b4-421c-b5da-ec2a5bce4380 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd" status: 200 len: 1265 microversion: 2.1 time: 0.205715 May 26 14:04:38.471518 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 486/1010] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:38 2022] GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:04:38.476317 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-310f1168-585c-4efb-b7dd-407714958a1a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:38.484431 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-310f1168-585c-4efb-b7dd-407714958a1a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1689 microversion: 2.1 time: 0.215866 May 26 14:04:38.485970 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 525/1011] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:38 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1689 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:04:39.214185 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ffb84b12-7370-4cdd-8dbc-c2d6ff427993 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:39.214801 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ffb84b12-7370-4cdd-8dbc-c2d6ff427993 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:39.221942 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ffb84b12-7370-4cdd-8dbc-c2d6ff427993 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:39.222419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ffb84b12-7370-4cdd-8dbc-c2d6ff427993 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:39.223232 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ffb84b12-7370-4cdd-8dbc-c2d6ff427993 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:39.223633 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ffb84b12-7370-4cdd-8dbc-c2d6ff427993 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:39.354171 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ffb84b12-7370-4cdd-8dbc-c2d6ff427993 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:39.361815 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ffb84b12-7370-4cdd-8dbc-c2d6ff427993 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1575 microversion: 2.1 time: 0.151417 May 26 14:04:39.362398 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 487/1012] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:39 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:39.487752 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1f5bb4e8-4735-4761-b82e-97734d62072f tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:39.488394 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1f5bb4e8-4735-4761-b82e-97734d62072f tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: e68d6609-e48d-4d4d-8327-48fbf40b6ebd] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:39.494934 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1f5bb4e8-4735-4761-b82e-97734d62072f tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:39.495481 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1f5bb4e8-4735-4761-b82e-97734d62072f tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:39.496261 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1f5bb4e8-4735-4761-b82e-97734d62072f tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:39.496744 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1f5bb4e8-4735-4761-b82e-97734d62072f tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:39.501808 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fef60092-0bde-4d5c-9f1c-776d1cdfa2bb tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:39.502621 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-fef60092-0bde-4d5c-9f1c-776d1cdfa2bb tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:39.509043 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fef60092-0bde-4d5c-9f1c-776d1cdfa2bb tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:39.509519 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fef60092-0bde-4d5c-9f1c-776d1cdfa2bb tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:39.510286 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fef60092-0bde-4d5c-9f1c-776d1cdfa2bb tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:39.510719 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fef60092-0bde-4d5c-9f1c-776d1cdfa2bb tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:39.682010 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1f5bb4e8-4735-4761-b82e-97734d62072f tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:39.690216 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1f5bb4e8-4735-4761-b82e-97734d62072f tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd" status: 200 len: 1265 microversion: 2.1 time: 0.206436 May 26 14:04:39.690780 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 526/1013] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:39 2022] GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:39.703883 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-fef60092-0bde-4d5c-9f1c-776d1cdfa2bb tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:39.711210 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-fef60092-0bde-4d5c-9f1c-776d1cdfa2bb tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1689 microversion: 2.1 time: 0.213311 May 26 14:04:39.711772 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 488/1014] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:39 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1689 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:04:40.619296 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8d4b41ec-ca0f-4a27-8349-1faa20f3e142 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:40.619914 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8d4b41ec-ca0f-4a27-8349-1faa20f3e142 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:40.626132 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8d4b41ec-ca0f-4a27-8349-1faa20f3e142 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:40.626577 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8d4b41ec-ca0f-4a27-8349-1faa20f3e142 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:40.627347 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8d4b41ec-ca0f-4a27-8349-1faa20f3e142 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:40.627782 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8d4b41ec-ca0f-4a27-8349-1faa20f3e142 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:40.707290 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7ea16d2d-8116-4d39-94a6-87e70a5b8241 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:40.707912 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7ea16d2d-8116-4d39-94a6-87e70a5b8241 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: e68d6609-e48d-4d4d-8327-48fbf40b6ebd] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:40.714757 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7ea16d2d-8116-4d39-94a6-87e70a5b8241 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:40.715137 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7ea16d2d-8116-4d39-94a6-87e70a5b8241 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:40.716457 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7ea16d2d-8116-4d39-94a6-87e70a5b8241 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:40.716908 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7ea16d2d-8116-4d39-94a6-87e70a5b8241 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:40.779935 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8d4b41ec-ca0f-4a27-8349-1faa20f3e142 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:40.790472 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8d4b41ec-ca0f-4a27-8349-1faa20f3e142 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1575 microversion: 2.1 time: 0.415277 May 26 14:04:40.791533 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 527/1015] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:40 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1575 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:40.799825 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-799c1828-7f90-4ea8-84cc-31b9c5b83651 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:40.800436 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-799c1828-7f90-4ea8-84cc-31b9c5b83651 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:40.808269 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-799c1828-7f90-4ea8-84cc-31b9c5b83651 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:40.808725 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-799c1828-7f90-4ea8-84cc-31b9c5b83651 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:40.809653 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-799c1828-7f90-4ea8-84cc-31b9c5b83651 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:40.810087 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-799c1828-7f90-4ea8-84cc-31b9c5b83651 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:40.924355 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7ea16d2d-8116-4d39-94a6-87e70a5b8241 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:40.933465 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7ea16d2d-8116-4d39-94a6-87e70a5b8241 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd" status: 200 len: 1265 microversion: 2.1 time: 0.229908 May 26 14:04:40.934155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 489/1016] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:40 2022] GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:04:40.940904 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-267dec2a-14b0-4e66-8b94-8f8cda1c0927 req-f2441a5c-9fed-4e8c-98d3-30d98de81265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e68d6609-e48d-4d4d-8327-48fbf40b6ebd", "name": "network-vif-plugged", "status": "completed", "tag": "caf319b9-9a28-4413-9e5b-84e2d576651e"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:04:40.951341 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-267dec2a-14b0-4e66-8b94-8f8cda1c0927 req-f2441a5c-9fed-4e8c-98d3-30d98de81265 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:40.951789 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-267dec2a-14b0-4e66-8b94-8f8cda1c0927 req-f2441a5c-9fed-4e8c-98d3-30d98de81265 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:40.963285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-267dec2a-14b0-4e66-8b94-8f8cda1c0927 req-f2441a5c-9fed-4e8c-98d3-30d98de81265 service nova] Creating event network-vif-plugged:caf319b9-9a28-4413-9e5b-84e2d576651e for instance e68d6609-e48d-4d4d-8327-48fbf40b6ebd on hv-cinder-84213 May 26 14:04:40.969401 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-267dec2a-14b0-4e66-8b94-8f8cda1c0927 req-f2441a5c-9fed-4e8c-98d3-30d98de81265 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033586 May 26 14:04:40.969942 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 490/1017] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:04:40.978046 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-799c1828-7f90-4ea8-84cc-31b9c5b83651 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:40.986272 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-799c1828-7f90-4ea8-84cc-31b9c5b83651 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1689 microversion: 2.1 time: 0.190210 May 26 14:04:40.986851 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 528/1018] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:40 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1689 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:41.808267 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-14a1b200-8501-4af8-8acb-91562acf912e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:41.808970 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-14a1b200-8501-4af8-8acb-91562acf912e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:41.815722 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-14a1b200-8501-4af8-8acb-91562acf912e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:41.816175 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-14a1b200-8501-4af8-8acb-91562acf912e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:41.816934 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-14a1b200-8501-4af8-8acb-91562acf912e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:41.817404 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-14a1b200-8501-4af8-8acb-91562acf912e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:41.949952 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-14a1b200-8501-4af8-8acb-91562acf912e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:41.950153 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-514cbffa-3f6c-4551-855a-d145ddd2bae1 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:41.950759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-514cbffa-3f6c-4551-855a-d145ddd2bae1 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: e68d6609-e48d-4d4d-8327-48fbf40b6ebd] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:41.957920 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-514cbffa-3f6c-4551-855a-d145ddd2bae1 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:41.958066 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-14a1b200-8501-4af8-8acb-91562acf912e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1562 microversion: 2.1 time: 0.154518 May 26 14:04:41.958372 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-514cbffa-3f6c-4551-855a-d145ddd2bae1 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:41.958626 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 491/1019] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:41 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:41.959132 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-514cbffa-3f6c-4551-855a-d145ddd2bae1 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:41.959561 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-514cbffa-3f6c-4551-855a-d145ddd2bae1 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:42.004250 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-20292146-8c42-4ab0-a26d-877b4a5f8eb2 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:42.004875 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-20292146-8c42-4ab0-a26d-877b4a5f8eb2 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:42.011283 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-20292146-8c42-4ab0-a26d-877b4a5f8eb2 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:42.011739 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-20292146-8c42-4ab0-a26d-877b4a5f8eb2 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:42.012504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-20292146-8c42-4ab0-a26d-877b4a5f8eb2 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:42.012947 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-20292146-8c42-4ab0-a26d-877b4a5f8eb2 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:42.129326 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-514cbffa-3f6c-4551-855a-d145ddd2bae1 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:42.137001 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-514cbffa-3f6c-4551-855a-d145ddd2bae1 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd" status: 200 len: 1265 microversion: 2.1 time: 0.190691 May 26 14:04:42.137681 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 529/1020] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:41 2022] GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:04:42.171610 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-20292146-8c42-4ab0-a26d-877b4a5f8eb2 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:42.180439 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-20292146-8c42-4ab0-a26d-877b4a5f8eb2 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1689 microversion: 2.1 time: 0.179979 May 26 14:04:42.181268 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 492/1021] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:41 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:04:43.155448 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5028da8e-c6c7-42e0-80b8-9cb50abef5f8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:43.156062 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5028da8e-c6c7-42e0-80b8-9cb50abef5f8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: e68d6609-e48d-4d4d-8327-48fbf40b6ebd] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:43.162580 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5028da8e-c6c7-42e0-80b8-9cb50abef5f8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:43.163030 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5028da8e-c6c7-42e0-80b8-9cb50abef5f8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:43.163800 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5028da8e-c6c7-42e0-80b8-9cb50abef5f8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:43.164518 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5028da8e-c6c7-42e0-80b8-9cb50abef5f8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:43.202048 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-feb30bab-f93b-48cb-8ee1-4ed26dde2fe0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:43.203239 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-feb30bab-f93b-48cb-8ee1-4ed26dde2fe0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:43.209858 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-feb30bab-f93b-48cb-8ee1-4ed26dde2fe0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:43.210643 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-feb30bab-f93b-48cb-8ee1-4ed26dde2fe0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:43.211642 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-feb30bab-f93b-48cb-8ee1-4ed26dde2fe0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:43.212297 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-feb30bab-f93b-48cb-8ee1-4ed26dde2fe0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:43.300232 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-feb30bab-f93b-48cb-8ee1-4ed26dde2fe0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:43.309196 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-feb30bab-f93b-48cb-8ee1-4ed26dde2fe0 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1621 microversion: 2.1 time: 0.114707 May 26 14:04:43.309844 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 493/1022] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:43 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1621 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:43.337541 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5028da8e-c6c7-42e0-80b8-9cb50abef5f8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:43.345040 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5028da8e-c6c7-42e0-80b8-9cb50abef5f8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd" status: 200 len: 1265 microversion: 2.1 time: 0.194107 May 26 14:04:43.345648 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 530/1023] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:43 2022] GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:43.497145 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-181c9566-0179-4774-bd83-0f6cf68c61b2 req-9216c3df-4bb9-41af-9072-d9c3e89eadd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa89e8ed-11d3-42d2-b030-5b7497694471", "name": "network-vif-deleted", "tag": "325f8a3e-5419-43f8-a8e8-0067da401f65"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:04:43.506757 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-181c9566-0179-4774-bd83-0f6cf68c61b2 req-9216c3df-4bb9-41af-9072-d9c3e89eadd1 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:43.507144 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-181c9566-0179-4774-bd83-0f6cf68c61b2 req-9216c3df-4bb9-41af-9072-d9c3e89eadd1 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:43.519207 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-181c9566-0179-4774-bd83-0f6cf68c61b2 req-9216c3df-4bb9-41af-9072-d9c3e89eadd1 service nova] Creating event network-vif-deleted:325f8a3e-5419-43f8-a8e8-0067da401f65 for instance aa89e8ed-11d3-42d2-b030-5b7497694471 on hv-cinder-84213 May 26 14:04:43.524130 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-181c9566-0179-4774-bd83-0f6cf68c61b2 req-9216c3df-4bb9-41af-9072-d9c3e89eadd1 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031502 May 26 14:04:43.524718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 494/1024] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:04:44.328429 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c1e1ee4e-8b4d-4e92-ae79-f5c92519eca1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:44.329185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c1e1ee4e-8b4d-4e92-ae79-f5c92519eca1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:44.337484 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c1e1ee4e-8b4d-4e92-ae79-f5c92519eca1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:44.337786 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c1e1ee4e-8b4d-4e92-ae79-f5c92519eca1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:44.338580 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c1e1ee4e-8b4d-4e92-ae79-f5c92519eca1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:44.339018 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c1e1ee4e-8b4d-4e92-ae79-f5c92519eca1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:44.362916 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-427ca219-fcca-4bf9-8ebf-7787145a8f27 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:44.364283 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-427ca219-fcca-4bf9-8ebf-7787145a8f27 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: e68d6609-e48d-4d4d-8327-48fbf40b6ebd] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:44.371278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-427ca219-fcca-4bf9-8ebf-7787145a8f27 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:44.371809 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-427ca219-fcca-4bf9-8ebf-7787145a8f27 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:44.372641 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-427ca219-fcca-4bf9-8ebf-7787145a8f27 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:44.373795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-427ca219-fcca-4bf9-8ebf-7787145a8f27 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:44.377662 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c1e1ee4e-8b4d-4e92-ae79-f5c92519eca1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:44.378299 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c1e1ee4e-8b4d-4e92-ae79-f5c92519eca1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:44.378757 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-c1e1ee4e-8b4d-4e92-ae79-f5c92519eca1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lazy-loading 'fault' on Instance uuid aa89e8ed-11d3-42d2-b030-5b7497694471 {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:04:44.433080 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c1e1ee4e-8b4d-4e92-ae79-f5c92519eca1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:44.441507 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c1e1ee4e-8b4d-4e92-ae79-f5c92519eca1 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 200 len: 1336 microversion: 2.1 time: 0.118440 May 26 14:04:44.442173 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 531/1025] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:44 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 1336 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:44.528070 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-427ca219-fcca-4bf9-8ebf-7787145a8f27 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:44.536844 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-427ca219-fcca-4bf9-8ebf-7787145a8f27 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd" status: 200 len: 1265 microversion: 2.1 time: 0.178229 May 26 14:04:44.537787 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 495/1026] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:44 2022] GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:45.458671 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8856e12d-81f4-456e-893e-337a6ffa2ba8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:45.459310 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8856e12d-81f4-456e-893e-337a6ffa2ba8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: aa89e8ed-11d3-42d2-b030-5b7497694471] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:45.465799 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8856e12d-81f4-456e-893e-337a6ffa2ba8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:45.466251 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8856e12d-81f4-456e-893e-337a6ffa2ba8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:45.467588 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8856e12d-81f4-456e-893e-337a6ffa2ba8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:45.468025 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8856e12d-81f4-456e-893e-337a6ffa2ba8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:45.481246 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-8856e12d-81f4-456e-893e-337a6ffa2ba8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] HTTP exception thrown: Instance aa89e8ed-11d3-42d2-b030-5b7497694471 could not be found. May 26 14:04:45.482818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8856e12d-81f4-456e-893e-337a6ffa2ba8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Request method failure captured: May 26 14:04:45.482818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 HTTP/1.1 May 26 14:04:45.482818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 14:04:45.482818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 14:04:45.482818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 14:04:45.482818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 14:04:45.482818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 14:04:45.482818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 14:04:45.482818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 14:04:45.482818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 14:04:45.482818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4b-Oa-X6jHN9Gz0z18y08tbmRNqhQxYbg6e0BLZYdSYeIsEe3D2y9tpoIKpFY4nKChjusqnkMX7zTWBNnntrwanhfW05syDJiYjjEY8aLgU67Tthga-5NQqGGlNnebZErUKMhE2yG3kiGK5Z82LAT1fimq3qIuG9eMK6nluEM7g7pc May 26 14:04:45.482818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 14:04:45.482818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 14:04:45.482818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 14:04:45.482818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 14:04:45.482818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 14:04:45.482818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 14:04:45.482818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: e3d27b9eb0ef4c338c18c2a1d02db444 May 26 14:04:45.482818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1535794059 May 26 14:04:45.482818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 14:04:45.482818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 14:04:45.484446 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/e3d27b9eb0ef4c338c18c2a1d02db444"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/e3d27b9eb0ef4c338c18c2a1d02db444"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/e3d27b9eb0ef4c338c18c2a1d02db444"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_e3d27b9eb0ef4c338c18c2a1d02db444", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:04:45.484446 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1535794059 May 26 14:04:45.484446 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: e3d27b9eb0ef4c338c18c2a1d02db444 May 26 14:04:45.484446 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1535794059 May 26 14:04:45.484446 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-ServerRescueNegativeTestJSON-1535794059-project May 26 14:04:45.484446 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 14:04:45.484446 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 14:04:45.484446 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: 8d7bcc48c8d844e5b36b1c4e2748e766 May 26 14:04:45.484446 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1535794059-project May 26 14:04:45.484446 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 14:04:45.484446 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Instance aa89e8ed-11d3-42d2-b030-5b7497694471 could not be found. May 26 14:04:45.484446 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': 'aa89e8ed-11d3-42d2-b030-5b7497694471'} May 26 14:04:45.485443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:04:45.485443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:04:45.485443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:04:45.485443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:04:45.485443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:04:45.485443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:04:45.485443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:04:45.485443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:04:45.485443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:04:45.485443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:04:45.485443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa89e8ed-11d3-42d2-b030-5b7497694471 could not be found. May 26 14:04:45.485443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:04:45.485443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:04:45.485443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:04:45.485443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:04:45.485443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:04:45.485443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:04:45.485443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:04:45.485443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:04:45.485443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:04:45.486971 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:04:45.486971 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:04:45.486971 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:04:45.486971 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:04:45.486971 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:04:45.486971 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:04:45.486971 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:04:45.486971 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa89e8ed-11d3-42d2-b030-5b7497694471 could not be found. May 26 14:04:45.486971 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:04:45.486971 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:04:45.486971 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:04:45.486971 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:04:45.486971 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:04:45.486971 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:04:45.486971 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:04:45.486971 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:04:45.486971 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa89e8ed-11d3-42d2-b030-5b7497694471 could not be found. May 26 14:04:45.486971 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:04:45.488803 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8856e12d-81f4-456e-893e-337a6ffa2ba8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Returning 404 to user: Instance aa89e8ed-11d3-42d2-b030-5b7497694471 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:04:45.488803 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8856e12d-81f4-456e-893e-337a6ffa2ba8 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471" status: 404 len: 111 microversion: 2.1 time: 0.029457 May 26 14:04:45.488803 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 532/1027] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:45 2022] GET /compute/v2.1/servers/aa89e8ed-11d3-42d2-b030-5b7497694471 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:04:45.492606 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-363ddb01-8a92-45ce-b433-945c04ae2c8a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '.version_select at 0x7f25a4bd7d30>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:45.509501 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-363ddb01-8a92-45ce-b433-945c04ae2c8a tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1096474030" status: 202 len: 0 microversion: 2.1 time: 0.020472 May 26 14:04:45.510077 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 496/1028] 10.222.0.91 () {58 vars in 1220 bytes} [Thu May 26 14:04:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1096474030 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 14:04:45.554740 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1d48ba35-efdc-4ea1-9585-73dc60e68c82 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:45.555354 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1d48ba35-efdc-4ea1-9585-73dc60e68c82 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: e68d6609-e48d-4d4d-8327-48fbf40b6ebd] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:45.562755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1d48ba35-efdc-4ea1-9585-73dc60e68c82 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:45.563198 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1d48ba35-efdc-4ea1-9585-73dc60e68c82 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:45.563959 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1d48ba35-efdc-4ea1-9585-73dc60e68c82 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:45.564385 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1d48ba35-efdc-4ea1-9585-73dc60e68c82 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:45.745025 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1d48ba35-efdc-4ea1-9585-73dc60e68c82 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:45.754118 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1d48ba35-efdc-4ea1-9585-73dc60e68c82 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd" status: 200 len: 1452 microversion: 2.1 time: 0.203194 May 26 14:04:45.754907 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 533/1029] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:45 2022] GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd => generated 1452 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:45.771464 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-22a367b0-93dd-41cb-81ea-74bd0d840cb0 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:45.772381 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-22a367b0-93dd-41cb-81ea-74bd0d840cb0 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: e68d6609-e48d-4d4d-8327-48fbf40b6ebd] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:45.778447 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-22a367b0-93dd-41cb-81ea-74bd0d840cb0 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:45.778898 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-22a367b0-93dd-41cb-81ea-74bd0d840cb0 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:45.779708 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-22a367b0-93dd-41cb-81ea-74bd0d840cb0 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:45.780199 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-22a367b0-93dd-41cb-81ea-74bd0d840cb0 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:45.800951 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:45.917661 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-22a367b0-93dd-41cb-81ea-74bd0d840cb0 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:45.925936 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-22a367b0-93dd-41cb-81ea-74bd0d840cb0 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd" status: 200 len: 1452 microversion: 2.1 time: 0.158625 May 26 14:04:45.926596 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 497/1030] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:45 2022] GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:47.805114 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-8d3ad398-d0e2-4021-bfd6-ac3ae5486381 req-c0102549-c95a-4a07-ab31-adf60765d6b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e68d6609-e48d-4d4d-8327-48fbf40b6ebd", "tag": "caf319b9-9a28-4413-9e5b-84e2d576651e"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:04:47.815184 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-8d3ad398-d0e2-4021-bfd6-ac3ae5486381 req-c0102549-c95a-4a07-ab31-adf60765d6b6 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:47.815720 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-8d3ad398-d0e2-4021-bfd6-ac3ae5486381 req-c0102549-c95a-4a07-ab31-adf60765d6b6 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:47.828584 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-8d3ad398-d0e2-4021-bfd6-ac3ae5486381 req-c0102549-c95a-4a07-ab31-adf60765d6b6 service nova] Creating event network-changed:caf319b9-9a28-4413-9e5b-84e2d576651e for instance e68d6609-e48d-4d4d-8327-48fbf40b6ebd on hv-cinder-84213 May 26 14:04:47.833979 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-8d3ad398-d0e2-4021-bfd6-ac3ae5486381 req-c0102549-c95a-4a07-ab31-adf60765d6b6 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032461 May 26 14:04:47.834699 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 534/1031] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:04:48.457333 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-09ac66ba-f4a2-41a1-bbff-45cb93edd5bc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:48.457840 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-09ac66ba-f4a2-41a1-bbff-45cb93edd5bc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:48.465514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09ac66ba-f4a2-41a1-bbff-45cb93edd5bc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:48.466044 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09ac66ba-f4a2-41a1-bbff-45cb93edd5bc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:48.468182 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09ac66ba-f4a2-41a1-bbff-45cb93edd5bc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:48.468702 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09ac66ba-f4a2-41a1-bbff-45cb93edd5bc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:48.494933 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-09ac66ba-f4a2-41a1-bbff-45cb93edd5bc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 14:04:48.578307 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-09ac66ba-f4a2-41a1-bbff-45cb93edd5bc tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "DELETE /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 204 len: 0 microversion: 2.1 time: 0.124559 May 26 14:04:48.581871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 498/1032] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 14:04:48 2022] DELETE /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 14:04:48.587769 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6884c689-2d55-4984-8b99-bf09733b62de tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:48.588473 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6884c689-2d55-4984-8b99-bf09733b62de tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:48.595700 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6884c689-2d55-4984-8b99-bf09733b62de tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:48.596322 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6884c689-2d55-4984-8b99-bf09733b62de tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:48.597134 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6884c689-2d55-4984-8b99-bf09733b62de tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:48.597620 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6884c689-2d55-4984-8b99-bf09733b62de tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:48.734713 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6884c689-2d55-4984-8b99-bf09733b62de tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:48.742785 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6884c689-2d55-4984-8b99-bf09733b62de tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1507 microversion: 2.1 time: 0.159239 May 26 14:04:48.743477 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 535/1033] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:48 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:49.761043 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fa0ddc00-92b1-4979-bea9-689cfddeea36 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:49.761791 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-fa0ddc00-92b1-4979-bea9-689cfddeea36 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:49.768528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fa0ddc00-92b1-4979-bea9-689cfddeea36 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:49.768981 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fa0ddc00-92b1-4979-bea9-689cfddeea36 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:49.769852 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fa0ddc00-92b1-4979-bea9-689cfddeea36 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:49.770293 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fa0ddc00-92b1-4979-bea9-689cfddeea36 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:49.903115 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-fa0ddc00-92b1-4979-bea9-689cfddeea36 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:49.910862 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-fa0ddc00-92b1-4979-bea9-689cfddeea36 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 200 len: 1507 microversion: 2.1 time: 0.154025 May 26 14:04:49.911341 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 499/1034] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:49 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:50.082223 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-db14a24c-dd1b-4cb8-9b44-485d2f9eae66 req-4d2e92b2-76ea-4f65-aa69-9a1a1d23a67e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e953c9eb-adb5-49a2-b9c2-03633d118240", "name": "network-vif-deleted", "tag": "9ea477a5-0b77-466c-b782-069bc53617e5"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:04:50.093683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-db14a24c-dd1b-4cb8-9b44-485d2f9eae66 req-4d2e92b2-76ea-4f65-aa69-9a1a1d23a67e service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:50.094869 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-db14a24c-dd1b-4cb8-9b44-485d2f9eae66 req-4d2e92b2-76ea-4f65-aa69-9a1a1d23a67e service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:50.111035 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-db14a24c-dd1b-4cb8-9b44-485d2f9eae66 req-4d2e92b2-76ea-4f65-aa69-9a1a1d23a67e service nova] Creating event network-vif-deleted:9ea477a5-0b77-466c-b782-069bc53617e5 for instance e953c9eb-adb5-49a2-b9c2-03633d118240 on hv-cinder-84213 May 26 14:04:50.117720 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-db14a24c-dd1b-4cb8-9b44-485d2f9eae66 req-4d2e92b2-76ea-4f65-aa69-9a1a1d23a67e service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039251 May 26 14:04:50.118628 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 536/1035] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:04:50.927730 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4535bc66-709c-4765-b54f-a9748bc3ac3b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:50.928334 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4535bc66-709c-4765-b54f-a9748bc3ac3b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: e953c9eb-adb5-49a2-b9c2-03633d118240] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:50.934962 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4535bc66-709c-4765-b54f-a9748bc3ac3b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:50.935906 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4535bc66-709c-4765-b54f-a9748bc3ac3b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:50.936683 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4535bc66-709c-4765-b54f-a9748bc3ac3b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:50.937116 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4535bc66-709c-4765-b54f-a9748bc3ac3b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:50.950163 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-4535bc66-709c-4765-b54f-a9748bc3ac3b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] HTTP exception thrown: Instance e953c9eb-adb5-49a2-b9c2-03633d118240 could not be found. May 26 14:04:50.952419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4535bc66-709c-4765-b54f-a9748bc3ac3b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Request method failure captured: May 26 14:04:50.952419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 HTTP/1.1 May 26 14:04:50.952419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 14:04:50.952419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 14:04:50.952419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 14:04:50.952419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 14:04:50.952419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 14:04:50.952419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 14:04:50.952419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 14:04:50.952419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 14:04:50.952419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4b-Oa-X6jHN9Gz0z18y08tbmRNqhQxYbg6e0BLZYdSYeIsEe3D2y9tpoIKpFY4nKChjusqnkMX7zTWBNnntrwanhfW05syDJiYjjEY8aLgU67Tthga-5NQqGGlNnebZErUKMhE2yG3kiGK5Z82LAT1fimq3qIuG9eMK6nluEM7g7pc May 26 14:04:50.952419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 14:04:50.952419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 14:04:50.952419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 14:04:50.952419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 14:04:50.952419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 14:04:50.952419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 14:04:50.952419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: e3d27b9eb0ef4c338c18c2a1d02db444 May 26 14:04:50.952419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1535794059 May 26 14:04:50.952419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 14:04:50.952419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 14:04:50.954171 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/e3d27b9eb0ef4c338c18c2a1d02db444"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/e3d27b9eb0ef4c338c18c2a1d02db444"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/e3d27b9eb0ef4c338c18c2a1d02db444"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_e3d27b9eb0ef4c338c18c2a1d02db444", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:04:50.954171 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1535794059 May 26 14:04:50.954171 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: e3d27b9eb0ef4c338c18c2a1d02db444 May 26 14:04:50.954171 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1535794059 May 26 14:04:50.954171 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-ServerRescueNegativeTestJSON-1535794059-project May 26 14:04:50.954171 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 14:04:50.954171 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 14:04:50.954171 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: 8d7bcc48c8d844e5b36b1c4e2748e766 May 26 14:04:50.954171 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1535794059-project May 26 14:04:50.954171 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: > May 26 14:04:50.954171 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Instance e953c9eb-adb5-49a2-b9c2-03633d118240 could not be found. May 26 14:04:50.954171 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'id': 'e953c9eb-adb5-49a2-b9c2-03633d118240'} May 26 14:04:50.955101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:04:50.955101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:04:50.955101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:04:50.955101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:04:50.955101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:04:50.955101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:04:50.955101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:04:50.955101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:04:50.955101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:04:50.955101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:04:50.955101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e953c9eb-adb5-49a2-b9c2-03633d118240 could not be found. May 26 14:04:50.955101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:04:50.955101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:04:50.955101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:04:50.955101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:04:50.955101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:04:50.955101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:04:50.955101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:04:50.955101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:04:50.955101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:04:50.956622 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:04:50.956622 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:04:50.956622 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:04:50.956622 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:04:50.956622 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:04:50.956622 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:04:50.956622 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:04:50.956622 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e953c9eb-adb5-49a2-b9c2-03633d118240 could not be found. May 26 14:04:50.956622 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:04:50.956622 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:04:50.956622 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:04:50.956622 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:04:50.956622 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:04:50.956622 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:04:50.956622 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:04:50.956622 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:04:50.956622 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e953c9eb-adb5-49a2-b9c2-03633d118240 could not be found. May 26 14:04:50.956622 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:04:50.958045 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4535bc66-709c-4765-b54f-a9748bc3ac3b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Returning 404 to user: Instance e953c9eb-adb5-49a2-b9c2-03633d118240 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:04:50.958045 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4535bc66-709c-4765-b54f-a9748bc3ac3b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240" status: 404 len: 111 microversion: 2.1 time: 0.029981 May 26 14:04:50.958045 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 500/1036] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:50 2022] GET /compute/v2.1/servers/e953c9eb-adb5-49a2-b9c2-03633d118240 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:04:50.962936 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8f26d657-7048-40c0-bfc6-d04c0f6060ff tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:50.963643 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8f26d657-7048-40c0-bfc6-d04c0f6060ff tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:50.969936 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8f26d657-7048-40c0-bfc6-d04c0f6060ff tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:50.970379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8f26d657-7048-40c0-bfc6-d04c0f6060ff tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:50.971137 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8f26d657-7048-40c0-bfc6-d04c0f6060ff tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:50.971583 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8f26d657-7048-40c0-bfc6-d04c0f6060ff tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:50.996016 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8f26d657-7048-40c0-bfc6-d04c0f6060ff tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 14:04:51.070669 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8f26d657-7048-40c0-bfc6-d04c0f6060ff tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "DELETE /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 204 len: 0 microversion: 2.1 time: 0.111678 May 26 14:04:51.071369 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 537/1037] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 14:04:50 2022] DELETE /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 14:04:51.079994 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-754439e1-5f40-4ca7-94fc-a62ddeb4a603 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:51.080846 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-754439e1-5f40-4ca7-94fc-a62ddeb4a603 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:51.086874 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-754439e1-5f40-4ca7-94fc-a62ddeb4a603 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:51.087324 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-754439e1-5f40-4ca7-94fc-a62ddeb4a603 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:51.088119 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-754439e1-5f40-4ca7-94fc-a62ddeb4a603 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:51.088555 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-754439e1-5f40-4ca7-94fc-a62ddeb4a603 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:51.218560 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-754439e1-5f40-4ca7-94fc-a62ddeb4a603 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:51.225989 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-754439e1-5f40-4ca7-94fc-a62ddeb4a603 tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.150402 May 26 14:04:51.226557 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 501/1038] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:51 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:52.243409 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f8b52241-90d8-413e-b220-8bd0d9727cae tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:52.244108 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f8b52241-90d8-413e-b220-8bd0d9727cae tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:52.246552 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:52.252051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f8b52241-90d8-413e-b220-8bd0d9727cae tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:52.252503 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f8b52241-90d8-413e-b220-8bd0d9727cae tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:52.253306 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f8b52241-90d8-413e-b220-8bd0d9727cae tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:52.253741 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f8b52241-90d8-413e-b220-8bd0d9727cae tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:52.391768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f8b52241-90d8-413e-b220-8bd0d9727cae tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7bcc48c8d844e5b36b1c4e2748e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d27b9eb0ef4c338c18c2a1d02db444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:52.400647 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f8b52241-90d8-413e-b220-8bd0d9727cae tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 200 len: 1521 microversion: 2.1 time: 0.161524 May 26 14:04:52.402065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 538/1039] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:52 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:52.428373 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-57cb3e39-8442-4922-9dfc-1fc7b5313aa6 req-dbbeedfe-5fda-4c4b-96a1-91fe1d9a622e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b980b635-eece-4c60-9b6c-e18d32bdc7da", "name": "network-vif-deleted", "tag": "d789974b-4593-46b6-9ee2-38b74839df10"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:04:52.439185 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-57cb3e39-8442-4922-9dfc-1fc7b5313aa6 req-dbbeedfe-5fda-4c4b-96a1-91fe1d9a622e service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:52.439686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-57cb3e39-8442-4922-9dfc-1fc7b5313aa6 req-dbbeedfe-5fda-4c4b-96a1-91fe1d9a622e service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:52.451982 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-57cb3e39-8442-4922-9dfc-1fc7b5313aa6 req-dbbeedfe-5fda-4c4b-96a1-91fe1d9a622e service nova] Creating event network-vif-deleted:d789974b-4593-46b6-9ee2-38b74839df10 for instance b980b635-eece-4c60-9b6c-e18d32bdc7da on hv-cinder-84213 May 26 14:04:52.458669 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-57cb3e39-8442-4922-9dfc-1fc7b5313aa6 req-dbbeedfe-5fda-4c4b-96a1-91fe1d9a622e service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033885 May 26 14:04:52.459680 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 502/1040] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:04:53.417442 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-25d70a6c-ed5d-4f3b-8b19-5fde482e5f9b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:53.418045 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-25d70a6c-ed5d-4f3b-8b19-5fde482e5f9b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] [instance: b980b635-eece-4c60-9b6c-e18d32bdc7da] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:53.425174 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-25d70a6c-ed5d-4f3b-8b19-5fde482e5f9b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:53.425628 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-25d70a6c-ed5d-4f3b-8b19-5fde482e5f9b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:53.426386 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-25d70a6c-ed5d-4f3b-8b19-5fde482e5f9b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:53.426817 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-25d70a6c-ed5d-4f3b-8b19-5fde482e5f9b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:53.441593 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-25d70a6c-ed5d-4f3b-8b19-5fde482e5f9b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] HTTP exception thrown: Instance b980b635-eece-4c60-9b6c-e18d32bdc7da could not be found. May 26 14:04:53.443195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-25d70a6c-ed5d-4f3b-8b19-5fde482e5f9b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Request method failure captured: May 26 14:04:53.443195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da HTTP/1.1 May 26 14:04:53.443195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 14:04:53.443195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 14:04:53.443195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 14:04:53.443195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 14:04:53.443195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 14:04:53.443195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 14:04:53.443195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 14:04:53.443195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 14:04:53.443195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4b-Oa-X6jHN9Gz0z18y08tbmRNqhQxYbg6e0BLZYdSYeIsEe3D2y9tpoIKpFY4nKChjusqnkMX7zTWBNnntrwanhfW05syDJiYjjEY8aLgU67Tthga-5NQqGGlNnebZErUKMhE2yG3kiGK5Z82LAT1fimq3qIuG9eMK6nluEM7g7pc May 26 14:04:53.443195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 14:04:53.443195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 14:04:53.443195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 14:04:53.443195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 14:04:53.443195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 14:04:53.443195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 14:04:53.443195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: e3d27b9eb0ef4c338c18c2a1d02db444 May 26 14:04:53.443195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1535794059 May 26 14:04:53.443195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 14:04:53.443195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 14:04:53.444836 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/e3d27b9eb0ef4c338c18c2a1d02db444"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/e3d27b9eb0ef4c338c18c2a1d02db444"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/e3d27b9eb0ef4c338c18c2a1d02db444"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_e3d27b9eb0ef4c338c18c2a1d02db444", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:04:53.444836 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1535794059 May 26 14:04:53.444836 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: e3d27b9eb0ef4c338c18c2a1d02db444 May 26 14:04:53.444836 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1535794059 May 26 14:04:53.444836 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-ServerRescueNegativeTestJSON-1535794059-project May 26 14:04:53.444836 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 14:04:53.444836 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 14:04:53.444836 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: 8d7bcc48c8d844e5b36b1c4e2748e766 May 26 14:04:53.444836 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1535794059-project May 26 14:04:53.444836 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 14:04:53.444836 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Instance b980b635-eece-4c60-9b6c-e18d32bdc7da could not be found. May 26 14:04:53.444836 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': 'b980b635-eece-4c60-9b6c-e18d32bdc7da'} May 26 14:04:53.445903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:04:53.445903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:04:53.445903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:04:53.445903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:04:53.445903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:04:53.445903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:04:53.445903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:04:53.445903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:04:53.445903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:04:53.445903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:04:53.445903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b980b635-eece-4c60-9b6c-e18d32bdc7da could not be found. May 26 14:04:53.445903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:04:53.445903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:04:53.445903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:04:53.445903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:04:53.445903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:04:53.445903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:04:53.445903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:04:53.445903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:04:53.445903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:04:53.447366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:04:53.447366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:04:53.447366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:04:53.447366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:04:53.447366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:04:53.447366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:04:53.447366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:04:53.447366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b980b635-eece-4c60-9b6c-e18d32bdc7da could not be found. May 26 14:04:53.447366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:04:53.447366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:04:53.447366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:04:53.447366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:04:53.447366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:04:53.447366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:04:53.447366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:04:53.447366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:04:53.447366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b980b635-eece-4c60-9b6c-e18d32bdc7da could not be found. May 26 14:04:53.447366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:04:53.448854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-25d70a6c-ed5d-4f3b-8b19-5fde482e5f9b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] Returning 404 to user: Instance b980b635-eece-4c60-9b6c-e18d32bdc7da could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:04:53.448854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-25d70a6c-ed5d-4f3b-8b19-5fde482e5f9b tempest-ServerRescueNegativeTestJSON-1535794059 tempest-ServerRescueNegativeTestJSON-1535794059-project] 10.222.0.91 "GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da" status: 404 len: 111 microversion: 2.1 time: 0.031029 May 26 14:04:53.448854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 539/1041] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:04:53 2022] GET /compute/v2.1/servers/b980b635-eece-4c60-9b6c-e18d32bdc7da => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 14:04:57.427874 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-be556d43-5967-4a88-910b-ec89d306e770 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-674567016"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:04:57.428534 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-be556d43-5967-4a88-910b-ec89d306e770 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:57.430437 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:57.436334 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-be556d43-5967-4a88-910b-ec89d306e770 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:57.436788 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-be556d43-5967-4a88-910b-ec89d306e770 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:57.437586 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-be556d43-5967-4a88-910b-ec89d306e770 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:57.438022 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-be556d43-5967-4a88-910b-ec89d306e770 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:57.569200 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.network.security_group_api [None req-be556d43-5967-4a88-910b-ec89d306e770 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Removing security group 94740b1a-7284-42d2-9e19-eb1e58806f3b from port c3710695-2c7b-4d4d-96bc-de38e27dc865 May 26 14:04:58.219990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-be556d43-5967-4a88-910b-ec89d306e770 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "POST /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b/action" status: 202 len: 0 microversion: 2.1 time: 1.027514 May 26 14:04:58.229571 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 503/1042] 10.222.0.91 () {60 vars in 1277 bytes} [Thu May 26 14:04:57 2022] POST /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b/action => generated 0 bytes in 1035 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:04:58.238632 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-8e5bb593-96f9-42d8-b85c-26c71bb46067 req-706f3581-c02a-46d1-b371-f5a4e021d7dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dddc973-36be-43e2-8971-e5e218dee91b", "tag": "c3710695-2c7b-4d4d-96bc-de38e27dc865"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:04:58.259413 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-8e5bb593-96f9-42d8-b85c-26c71bb46067 req-706f3581-c02a-46d1-b371-f5a4e021d7dd service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:58.260236 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-8e5bb593-96f9-42d8-b85c-26c71bb46067 req-706f3581-c02a-46d1-b371-f5a4e021d7dd service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:58.281767 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-8e5bb593-96f9-42d8-b85c-26c71bb46067 req-706f3581-c02a-46d1-b371-f5a4e021d7dd service nova] Creating event network-changed:c3710695-2c7b-4d4d-96bc-de38e27dc865 for instance 5dddc973-36be-43e2-8971-e5e218dee91b on hv-cinder-84213 May 26 14:04:58.290419 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-8e5bb593-96f9-42d8-b85c-26c71bb46067 req-706f3581-c02a-46d1-b371-f5a4e021d7dd service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056275 May 26 14:04:58.291947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 540/1043] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:05:00.143380 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bd5f1bb5-1a88-4a89-a0c7-9387d3255109 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:00.144508 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bd5f1bb5-1a88-4a89-a0c7-9387d3255109 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:00.145711 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-2073dce5-824a-4fb0-96aa-e93b75b58b90 req-23c82aec-751b-49fb-b1e7-4052432ce2d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dddc973-36be-43e2-8971-e5e218dee91b", "tag": "c3710695-2c7b-4d4d-96bc-de38e27dc865"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:05:00.152018 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bd5f1bb5-1a88-4a89-a0c7-9387d3255109 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:00.155428 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bd5f1bb5-1a88-4a89-a0c7-9387d3255109 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:00.156792 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bd5f1bb5-1a88-4a89-a0c7-9387d3255109 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:00.157441 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bd5f1bb5-1a88-4a89-a0c7-9387d3255109 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:00.158399 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-2073dce5-824a-4fb0-96aa-e93b75b58b90 req-23c82aec-751b-49fb-b1e7-4052432ce2d8 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:00.160495 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-2073dce5-824a-4fb0-96aa-e93b75b58b90 req-23c82aec-751b-49fb-b1e7-4052432ce2d8 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:00.176656 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-2073dce5-824a-4fb0-96aa-e93b75b58b90 req-23c82aec-751b-49fb-b1e7-4052432ce2d8 service nova] Creating event network-changed:c3710695-2c7b-4d4d-96bc-de38e27dc865 for instance 5dddc973-36be-43e2-8971-e5e218dee91b on hv-cinder-84213 May 26 14:05:00.186017 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-2073dce5-824a-4fb0-96aa-e93b75b58b90 req-23c82aec-751b-49fb-b1e7-4052432ce2d8 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045436 May 26 14:05:00.187336 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 541/1044] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:05:00.260583 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-bd5f1bb5-1a88-4a89-a0c7-9387d3255109 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lazy-loading 'services' on Instance uuid 5dddc973-36be-43e2-8971-e5e218dee91b {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:05:00.359017 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bd5f1bb5-1a88-4a89-a0c7-9387d3255109 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "DELETE /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b/os-volume_attachments/b53b7164-a300-44cd-bbbc-d376586f885e" status: 202 len: 0 microversion: 2.1 time: 0.220706 May 26 14:05:00.360178 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 504/1045] 10.222.0.91 () {58 vars in 1415 bytes} [Thu May 26 14:05:00 2022] DELETE /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b/os-volume_attachments/b53b7164-a300-44cd-bbbc-d376586f885e => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:05:00.368802 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-88d9114e-c608-4649-bbb9-98868872bc1b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:00.369891 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-88d9114e-c608-4649-bbb9-98868872bc1b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:00.376644 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-88d9114e-c608-4649-bbb9-98868872bc1b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:00.378049 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-88d9114e-c608-4649-bbb9-98868872bc1b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:00.379032 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-88d9114e-c608-4649-bbb9-98868872bc1b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:00.379640 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-88d9114e-c608-4649-bbb9-98868872bc1b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:00.385949 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:05:00.418197 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-88d9114e-c608-4649-bbb9-98868872bc1b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053686 May 26 14:05:00.426275 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 542/1046] 10.222.0.91 () {58 vars in 1301 bytes} [Thu May 26 14:05:00 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:05:01.437881 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-822c3bbf-46ec-48a4-bf24-b245d447a0c7 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:01.438998 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-822c3bbf-46ec-48a4-bf24-b245d447a0c7 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:01.448892 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-822c3bbf-46ec-48a4-bf24-b245d447a0c7 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:01.449847 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-822c3bbf-46ec-48a4-bf24-b245d447a0c7 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:01.450903 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-822c3bbf-46ec-48a4-bf24-b245d447a0c7 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:01.451795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-822c3bbf-46ec-48a4-bf24-b245d447a0c7 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:01.507024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-822c3bbf-46ec-48a4-bf24-b245d447a0c7 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076207 May 26 14:05:01.508456 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 505/1047] 10.222.0.91 () {58 vars in 1301 bytes} [Thu May 26 14:05:01 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:05:02.520808 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-41e90c8c-fa8c-4a6c-8813-8174d7ca53fe tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:02.522577 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-41e90c8c-fa8c-4a6c-8813-8174d7ca53fe tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:02.531462 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-41e90c8c-fa8c-4a6c-8813-8174d7ca53fe tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:02.532074 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-41e90c8c-fa8c-4a6c-8813-8174d7ca53fe tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:02.545292 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-41e90c8c-fa8c-4a6c-8813-8174d7ca53fe tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:02.545759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-41e90c8c-fa8c-4a6c-8813-8174d7ca53fe tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:02.580588 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-41e90c8c-fa8c-4a6c-8813-8174d7ca53fe tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064261 May 26 14:05:02.582309 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 543/1048] 10.222.0.91 () {58 vars in 1301 bytes} [Thu May 26 14:05:02 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 14:05:02.593360 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ff38babc-a9fe-462e-ba82-17d99c13f6b9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:02.595108 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ff38babc-a9fe-462e-ba82-17d99c13f6b9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:02.602897 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ff38babc-a9fe-462e-ba82-17d99c13f6b9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:02.603632 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ff38babc-a9fe-462e-ba82-17d99c13f6b9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:02.604599 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ff38babc-a9fe-462e-ba82-17d99c13f6b9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:02.605226 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ff38babc-a9fe-462e-ba82-17d99c13f6b9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:02.704132 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-ff38babc-a9fe-462e-ba82-17d99c13f6b9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] HTTP exception thrown: Instance 5dddc973-36be-43e2-8971-e5e218dee91b is not attached to volume b53b7164-a300-44cd-bbbc-d376586f885e May 26 14:05:02.717255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ff38babc-a9fe-462e-ba82-17d99c13f6b9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Request method failure captured: May 26 14:05:02.717255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: DELETE /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b/os-volume_attachments/b53b7164-a300-44cd-bbbc-d376586f885e HTTP/1.1 May 26 14:05:02.717255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 14:05:02.717255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 14:05:02.717255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 14:05:02.717255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 14:05:02.717255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 14:05:02.717255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 14:05:02.717255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 14:05:02.717255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 14:05:02.717255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4fOesTXPUlhxR3IdqDFvZeCkKwWbDTEURmWnirkIuwOHVilu6W-IybxtK73gBWzOy03mXRLh60kDo9vkKooXO23Pq5uw25iYkKzFaUiWGeqEoEkAAgRfIDa5jkhpYgydrdseMRIkMNLa8IQ9hkIsbNkl7M698gg6lXFH6ei6D9HAK4 May 26 14:05:02.717255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 14:05:02.717255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 14:05:02.717255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 14:05:02.717255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 14:05:02.717255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 14:05:02.717255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 14:05:02.717255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: 08ed6980f1214f6789f94f34a4c68e6e May 26 14:05:02.717255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-TestMinimumBasicScenario-58948697 May 26 14:05:02.717255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 14:05:02.717255 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 14:05:02.719075 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/08ed6980f1214f6789f94f34a4c68e6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/08ed6980f1214f6789f94f34a4c68e6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/08ed6980f1214f6789f94f34a4c68e6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_08ed6980f1214f6789f94f34a4c68e6e", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:05:02.719075 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-TestMinimumBasicScenario-58948697 May 26 14:05:02.719075 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 08ed6980f1214f6789f94f34a4c68e6e May 26 14:05:02.719075 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-TestMinimumBasicScenario-58948697 May 26 14:05:02.719075 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-TestMinimumBasicScenario-58948697-project May 26 14:05:02.719075 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 14:05:02.719075 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 14:05:02.719075 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: 0e7ef003bc5642feadfa1f9f631ef903 May 26 14:05:02.719075 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-TestMinimumBasicScenario-58948697-project May 26 14:05:02.719075 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: > May 26 14:05:02.719075 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Instance 5dddc973-36be-43e2-8971-e5e218dee91b is not attached to volume b53b7164-a300-44cd-bbbc-d376586f885e May 26 14:05:02.720024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'server_id': '5dddc973-36be-43e2-8971-e5e218dee91b', 'id': 'b53b7164-a300-44cd-bbbc-d376586f885e'} May 26 14:05:02.720024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:05:02.720024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:05:02.720024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 26 14:05:02.720024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 26 14:05:02.720024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 14:05:02.720024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 14:05:02.720024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 26 14:05:02.720024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 26 14:05:02.720024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b53b7164-a300-44cd-bbbc-d376586f885e. May 26 14:05:02.720024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:05:02.720024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:05:02.720024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:05:02.720024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:05:02.720024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:05:02.720024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:05:02.720024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:05:02.720024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:05:02.720024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:05:02.721601 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:05:02.721601 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 26 14:05:02.721601 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 26 14:05:02.721601 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dddc973-36be-43e2-8971-e5e218dee91b is not attached to volume b53b7164-a300-44cd-bbbc-d376586f885e May 26 14:05:02.721601 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:05:02.721601 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:05:02.721601 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:05:02.721601 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:05:02.721601 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:05:02.721601 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:05:02.721601 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:05:02.721601 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:05:02.721601 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dddc973-36be-43e2-8971-e5e218dee91b is not attached to volume b53b7164-a300-44cd-bbbc-d376586f885e May 26 14:05:02.721601 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:05:02.724350 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ff38babc-a9fe-462e-ba82-17d99c13f6b9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Returning 404 to user: Instance 5dddc973-36be-43e2-8971-e5e218dee91b is not attached to volume b53b7164-a300-44cd-bbbc-d376586f885e {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:05:02.726093 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ff38babc-a9fe-462e-ba82-17d99c13f6b9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "DELETE /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b/os-volume_attachments/b53b7164-a300-44cd-bbbc-d376586f885e" status: 404 len: 154 microversion: 2.1 time: 0.137790 May 26 14:05:02.731111 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 506/1049] 10.222.0.91 () {58 vars in 1415 bytes} [Thu May 26 14:05:02 2022] DELETE /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b/os-volume_attachments/b53b7164-a300-44cd-bbbc-d376586f885e => generated 154 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:05:03.115078 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6be428fc-eeee-48e2-ad13-fc7c4274ddba tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Action: 'create', calling method: .version_select at 0x7f25a4ac4b80>, body: {"keypair": {"name": "tempest-keypair-911970470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKr1QCld/KpHtZdMLQMZWy2+vcejuP3TFdh2k3QUbbv3dXmLneuf7VBhV1juKGT/vRuFvMbcccBaAWCrhXVgXq7jPUsPOclmRCXEUqeqYVuu/yg/c9JjrhbOgsV454Ixw=="}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:05:03.131357 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-6be428fc-eeee-48e2-ad13-fc7c4274ddba tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Getting quotas for project 3fcd25a6c4574894a8270e3a43af782d. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 14:05:03.135684 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-6be428fc-eeee-48e2-ad13-fc7c4274ddba tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Getting quotas for user 18906ec812ac49b8ba849775215c4318 and project 3fcd25a6c4574894a8270e3a43af782d. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 14:05:03.162085 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6be428fc-eeee-48e2-ad13-fc7c4274ddba tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.212404 May 26 14:05:03.163277 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 544/1050] 10.222.0.91 () {60 vars in 1158 bytes} [Thu May 26 14:05:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:05:03.897875 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-821141a7-d88f-477a-8607-adc8f31b9ef9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:03.898940 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-821141a7-d88f-477a-8607-adc8f31b9ef9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:03.906388 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-821141a7-d88f-477a-8607-adc8f31b9ef9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:03.906839 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-821141a7-d88f-477a-8607-adc8f31b9ef9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:03.907830 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-821141a7-d88f-477a-8607-adc8f31b9ef9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:03.908345 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-821141a7-d88f-477a-8607-adc8f31b9ef9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:03.935338 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-821141a7-d88f-477a-8607-adc8f31b9ef9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 14:05:04.027317 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-821141a7-d88f-477a-8607-adc8f31b9ef9 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "DELETE /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 204 len: 0 microversion: 2.1 time: 0.132955 May 26 14:05:04.028149 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 507/1051] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 14:05:03 2022] DELETE /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 14:05:04.037455 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ef9d6e3b-c2fe-48be-aaed-5482cf3579fe tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:04.038626 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ef9d6e3b-c2fe-48be-aaed-5482cf3579fe tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:04.048339 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ef9d6e3b-c2fe-48be-aaed-5482cf3579fe tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:04.048797 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ef9d6e3b-c2fe-48be-aaed-5482cf3579fe tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:04.049930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ef9d6e3b-c2fe-48be-aaed-5482cf3579fe tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:04.052867 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ef9d6e3b-c2fe-48be-aaed-5482cf3579fe tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:04.302946 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ef9d6e3b-c2fe-48be-aaed-5482cf3579fe tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:04.312107 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ef9d6e3b-c2fe-48be-aaed-5482cf3579fe tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1554 microversion: 2.1 time: 0.279457 May 26 14:05:04.312678 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 545/1052] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:04 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1554 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:04.624823 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-643f0241-0505-4aa6-97de-c369ac82419a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-713962025", "imageRef": "bcaacfae-fe2c-455f-a6e1-b08361c6fa8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "48f83048-1a6c-4ff2-af0b-d6658384b0a0"}], "security_groups": [{"name": "tempest-securitygroup--1090416338"}], "key_name": "tempest-keypair-911970470", "user_data": "}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:05:04.728347 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-643f0241-0505-4aa6-97de-c369ac82419a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] validate_networks() for [('48f83048-1a6c-4ff2-af0b-d6658384b0a0', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 14:05:05.099952 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-643f0241-0505-4aa6-97de-c369ac82419a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 14:05:05.100527 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-643f0241-0505-4aa6-97de-c369ac82419a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 14:05:05.100978 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-643f0241-0505-4aa6-97de-c369ac82419a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 14:05:05.101500 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-643f0241-0505-4aa6-97de-c369ac82419a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 14:05:05.101989 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-643f0241-0505-4aa6-97de-c369ac82419a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 14:05:05.111318 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-643f0241-0505-4aa6-97de-c369ac82419a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:05.112365 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-643f0241-0505-4aa6-97de-c369ac82419a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:05.113277 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-643f0241-0505-4aa6-97de-c369ac82419a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:05.113807 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-643f0241-0505-4aa6-97de-c369ac82419a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:05.131446 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-643f0241-0505-4aa6-97de-c369ac82419a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Getting quotas for project 3fcd25a6c4574894a8270e3a43af782d. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 14:05:05.135570 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-643f0241-0505-4aa6-97de-c369ac82419a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Getting quotas for user 18906ec812ac49b8ba849775215c4318 and project 3fcd25a6c4574894a8270e3a43af782d. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 14:05:05.147413 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-643f0241-0505-4aa6-97de-c369ac82419a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 14:05:05.150158 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-643f0241-0505-4aa6-97de-c369ac82419a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bcaacfae-fe2c-455f-a6e1-b08361c6fa8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 14:05:05.201743 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-643f0241-0505-4aa6-97de-c369ac82419a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.581848 May 26 14:05:05.202744 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 508/1053] 10.222.0.91 () {60 vars in 1146 bytes} [Thu May 26 14:05:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 14:05:05.212193 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e2b7ce34-9445-469c-a855-d9297974e98e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:05.213433 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e2b7ce34-9445-469c-a855-d9297974e98e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:05.272471 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e2b7ce34-9445-469c-a855-d9297974e98e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:05.280978 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e2b7ce34-9445-469c-a855-d9297974e98e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1236 microversion: 2.1 time: 0.071946 May 26 14:05:05.282277 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 546/1054] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:05 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1236 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:05.329992 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d6d9f6a0-5af3-42a8-9b71-7cafc28a1482 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:05.330923 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d6d9f6a0-5af3-42a8-9b71-7cafc28a1482 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:05.337924 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d6d9f6a0-5af3-42a8-9b71-7cafc28a1482 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:05.338554 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d6d9f6a0-5af3-42a8-9b71-7cafc28a1482 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:05.339580 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d6d9f6a0-5af3-42a8-9b71-7cafc28a1482 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:05.340274 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d6d9f6a0-5af3-42a8-9b71-7cafc28a1482 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:05.489978 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d6d9f6a0-5af3-42a8-9b71-7cafc28a1482 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:05.500617 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d6d9f6a0-5af3-42a8-9b71-7cafc28a1482 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1554 microversion: 2.1 time: 0.175235 May 26 14:05:05.501735 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 509/1055] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:05 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:06.298822 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3cbe09af-809d-4a9e-9184-0db1e267e9b1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:06.299440 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3cbe09af-809d-4a9e-9184-0db1e267e9b1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:06.306702 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3cbe09af-809d-4a9e-9184-0db1e267e9b1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:06.307152 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3cbe09af-809d-4a9e-9184-0db1e267e9b1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:06.307928 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3cbe09af-809d-4a9e-9184-0db1e267e9b1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:06.308366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3cbe09af-809d-4a9e-9184-0db1e267e9b1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:06.369181 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3cbe09af-809d-4a9e-9184-0db1e267e9b1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:06.377515 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3cbe09af-809d-4a9e-9184-0db1e267e9b1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1288 microversion: 2.1 time: 0.082595 May 26 14:05:06.378200 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 547/1056] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:06 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1288 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:06.518291 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-20aa252a-d521-4143-b3d6-39435545ec2b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:06.519018 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-20aa252a-d521-4143-b3d6-39435545ec2b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:06.525805 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-20aa252a-d521-4143-b3d6-39435545ec2b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:06.526467 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-20aa252a-d521-4143-b3d6-39435545ec2b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:06.527264 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-20aa252a-d521-4143-b3d6-39435545ec2b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:06.527702 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-20aa252a-d521-4143-b3d6-39435545ec2b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:06.682195 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-20aa252a-d521-4143-b3d6-39435545ec2b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:06.694012 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-20aa252a-d521-4143-b3d6-39435545ec2b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1554 microversion: 2.1 time: 0.179744 May 26 14:05:06.698527 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 510/1057] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:06 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:07.395336 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-513a1cfa-8ef0-4468-bfad-ce202e37db6b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:07.396183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-513a1cfa-8ef0-4468-bfad-ce202e37db6b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:07.402657 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-513a1cfa-8ef0-4468-bfad-ce202e37db6b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:07.403118 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-513a1cfa-8ef0-4468-bfad-ce202e37db6b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:07.403919 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-513a1cfa-8ef0-4468-bfad-ce202e37db6b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:07.404355 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-513a1cfa-8ef0-4468-bfad-ce202e37db6b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:07.471339 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-513a1cfa-8ef0-4468-bfad-ce202e37db6b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:07.479029 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-513a1cfa-8ef0-4468-bfad-ce202e37db6b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1294 microversion: 2.1 time: 0.088380 May 26 14:05:07.479692 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 548/1058] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:07 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:07.713718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-483724f1-3e0f-434a-bf15-f227778e709d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:07.714335 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-483724f1-3e0f-434a-bf15-f227778e709d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:07.720989 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-483724f1-3e0f-434a-bf15-f227778e709d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:07.721475 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-483724f1-3e0f-434a-bf15-f227778e709d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:07.722250 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-483724f1-3e0f-434a-bf15-f227778e709d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:07.722690 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-483724f1-3e0f-434a-bf15-f227778e709d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:07.855329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-483724f1-3e0f-434a-bf15-f227778e709d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e7ef003bc5642feadfa1f9f631ef903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ed6980f1214f6789f94f34a4c68e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:07.863502 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-483724f1-3e0f-434a-bf15-f227778e709d tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 200 len: 1554 microversion: 2.1 time: 0.153925 May 26 14:05:07.864095 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 511/1059] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:07 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:08.098972 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-7d5c894d-7bc7-4391-88c8-a06219adc092 req-79cc7920-b745-4a2d-b89d-0f5d92636e93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dddc973-36be-43e2-8971-e5e218dee91b", "name": "network-vif-deleted", "tag": "c3710695-2c7b-4d4d-96bc-de38e27dc865"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:05:08.107922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-7d5c894d-7bc7-4391-88c8-a06219adc092 req-79cc7920-b745-4a2d-b89d-0f5d92636e93 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:08.108361 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-7d5c894d-7bc7-4391-88c8-a06219adc092 req-79cc7920-b745-4a2d-b89d-0f5d92636e93 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:08.119136 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-7d5c894d-7bc7-4391-88c8-a06219adc092 req-79cc7920-b745-4a2d-b89d-0f5d92636e93 service nova] Creating event network-vif-deleted:c3710695-2c7b-4d4d-96bc-de38e27dc865 for instance 5dddc973-36be-43e2-8971-e5e218dee91b on hv-cinder-84213 May 26 14:05:08.125200 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-7d5c894d-7bc7-4391-88c8-a06219adc092 req-79cc7920-b745-4a2d-b89d-0f5d92636e93 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029812 May 26 14:05:08.126086 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 549/1060] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:05:08.496299 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-08744892-c0d6-47b4-a742-a2c144c676dd tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:08.497099 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-08744892-c0d6-47b4-a742-a2c144c676dd tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:08.504842 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-08744892-c0d6-47b4-a742-a2c144c676dd tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:08.505331 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-08744892-c0d6-47b4-a742-a2c144c676dd tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:08.506399 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-08744892-c0d6-47b4-a742-a2c144c676dd tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:08.506843 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-08744892-c0d6-47b4-a742-a2c144c676dd tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:08.536417 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:05:08.655571 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-08744892-c0d6-47b4-a742-a2c144c676dd tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:08.663853 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-08744892-c0d6-47b4-a742-a2c144c676dd tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1362 microversion: 2.1 time: 0.171557 May 26 14:05:08.664759 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 512/1061] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:08 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:08.882417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-acf8b3f4-6bcf-4253-a124-396fe8a90e91 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:08.883132 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-acf8b3f4-6bcf-4253-a124-396fe8a90e91 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] [instance: 5dddc973-36be-43e2-8971-e5e218dee91b] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:08.889429 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-acf8b3f4-6bcf-4253-a124-396fe8a90e91 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:08.889878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-acf8b3f4-6bcf-4253-a124-396fe8a90e91 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:08.890663 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-acf8b3f4-6bcf-4253-a124-396fe8a90e91 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:08.891349 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-acf8b3f4-6bcf-4253-a124-396fe8a90e91 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:08.907459 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-acf8b3f4-6bcf-4253-a124-396fe8a90e91 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] HTTP exception thrown: Instance 5dddc973-36be-43e2-8971-e5e218dee91b could not be found. May 26 14:05:08.909140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-acf8b3f4-6bcf-4253-a124-396fe8a90e91 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Request method failure captured: May 26 14:05:08.909140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b HTTP/1.1 May 26 14:05:08.909140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 14:05:08.909140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 14:05:08.909140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 14:05:08.909140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 14:05:08.909140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 14:05:08.909140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 14:05:08.909140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 14:05:08.909140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 14:05:08.909140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4fOesTXPUlhxR3IdqDFvZeCkKwWbDTEURmWnirkIuwOHVilu6W-IybxtK73gBWzOy03mXRLh60kDo9vkKooXO23Pq5uw25iYkKzFaUiWGeqEoEkAAgRfIDa5jkhpYgydrdseMRIkMNLa8IQ9hkIsbNkl7M698gg6lXFH6ei6D9HAK4 May 26 14:05:08.909140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 14:05:08.909140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 14:05:08.909140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 14:05:08.909140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 14:05:08.909140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 14:05:08.909140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 14:05:08.909140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: 08ed6980f1214f6789f94f34a4c68e6e May 26 14:05:08.909140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-TestMinimumBasicScenario-58948697 May 26 14:05:08.909140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 14:05:08.909140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 14:05:08.910786 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/08ed6980f1214f6789f94f34a4c68e6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/08ed6980f1214f6789f94f34a4c68e6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/08ed6980f1214f6789f94f34a4c68e6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_08ed6980f1214f6789f94f34a4c68e6e", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:05:08.910786 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-TestMinimumBasicScenario-58948697 May 26 14:05:08.910786 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 08ed6980f1214f6789f94f34a4c68e6e May 26 14:05:08.910786 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-TestMinimumBasicScenario-58948697 May 26 14:05:08.910786 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-TestMinimumBasicScenario-58948697-project May 26 14:05:08.910786 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 14:05:08.910786 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 14:05:08.910786 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: 0e7ef003bc5642feadfa1f9f631ef903 May 26 14:05:08.910786 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-TestMinimumBasicScenario-58948697-project May 26 14:05:08.910786 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 14:05:08.910786 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Instance 5dddc973-36be-43e2-8971-e5e218dee91b could not be found. May 26 14:05:08.910786 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': '5dddc973-36be-43e2-8971-e5e218dee91b'} May 26 14:05:08.911922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:05:08.911922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:05:08.911922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:05:08.911922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:05:08.911922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:05:08.911922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:05:08.911922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:05:08.911922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:05:08.911922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:05:08.911922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:05:08.911922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dddc973-36be-43e2-8971-e5e218dee91b could not be found. May 26 14:05:08.911922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:05:08.911922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:05:08.911922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:05:08.911922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:05:08.911922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:05:08.911922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:05:08.911922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:05:08.911922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:05:08.911922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:05:08.913183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:05:08.913183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:05:08.913183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:05:08.913183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:05:08.913183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:05:08.913183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:05:08.913183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:05:08.913183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dddc973-36be-43e2-8971-e5e218dee91b could not be found. May 26 14:05:08.913183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:05:08.913183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:05:08.913183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:05:08.913183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:05:08.913183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:05:08.913183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:05:08.913183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:05:08.913183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:05:08.913183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dddc973-36be-43e2-8971-e5e218dee91b could not be found. May 26 14:05:08.913183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:05:08.915048 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-acf8b3f4-6bcf-4253-a124-396fe8a90e91 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Returning 404 to user: Instance 5dddc973-36be-43e2-8971-e5e218dee91b could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:05:08.915048 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-acf8b3f4-6bcf-4253-a124-396fe8a90e91 tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b" status: 404 len: 111 microversion: 2.1 time: 0.033203 May 26 14:05:08.915048 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 550/1062] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:08 2022] GET /compute/v2.1/servers/5dddc973-36be-43e2-8971-e5e218dee91b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:05:08.919976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-17760d73-4bb6-4719-bbba-7a767d18ce2b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] Calling method '.version_select at 0x7f25a4d10790>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:08.937596 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-17760d73-4bb6-4719-bbba-7a767d18ce2b tempest-TestMinimumBasicScenario-58948697 tempest-TestMinimumBasicScenario-58948697-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1119065625" status: 202 len: 0 microversion: 2.1 time: 0.021873 May 26 14:05:08.938233 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 513/1063] 10.222.0.91 () {58 vars in 1271 bytes} [Thu May 26 14:05:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1119065625 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:05:09.681274 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-48d5de27-a972-4a4f-aa9c-7196b1f07246 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:09.681973 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-48d5de27-a972-4a4f-aa9c-7196b1f07246 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:09.688389 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-48d5de27-a972-4a4f-aa9c-7196b1f07246 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:09.688907 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-48d5de27-a972-4a4f-aa9c-7196b1f07246 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:09.690083 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-48d5de27-a972-4a4f-aa9c-7196b1f07246 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:09.690755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-48d5de27-a972-4a4f-aa9c-7196b1f07246 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:09.934449 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-48d5de27-a972-4a4f-aa9c-7196b1f07246 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:09.942954 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-48d5de27-a972-4a4f-aa9c-7196b1f07246 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1362 microversion: 2.1 time: 0.265668 May 26 14:05:09.943760 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 551/1064] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:09 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:10.140349 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-ca7e48c4-4ded-4f85-b972-ec7c18814c56 req-c409e6be-4a30-478e-a6d4-055eb3d206cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73a8a362-d930-47d5-b449-fec49325ba7a", "tag": "a40f207c-1239-46bb-af6c-60ad2e69d6db"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:05:10.149949 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-ca7e48c4-4ded-4f85-b972-ec7c18814c56 req-c409e6be-4a30-478e-a6d4-055eb3d206cf service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:10.150395 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-ca7e48c4-4ded-4f85-b972-ec7c18814c56 req-c409e6be-4a30-478e-a6d4-055eb3d206cf service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:10.161224 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-ca7e48c4-4ded-4f85-b972-ec7c18814c56 req-c409e6be-4a30-478e-a6d4-055eb3d206cf service nova] Creating event network-changed:a40f207c-1239-46bb-af6c-60ad2e69d6db for instance 73a8a362-d930-47d5-b449-fec49325ba7a on hv-cinder-84213 May 26 14:05:10.166022 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-ca7e48c4-4ded-4f85-b972-ec7c18814c56 req-c409e6be-4a30-478e-a6d4-055eb3d206cf service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029898 May 26 14:05:10.166609 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 514/1065] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:05:10.964788 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b8defd1a-f28f-4ad3-91a0-4a7da0fb5274 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:10.965462 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b8defd1a-f28f-4ad3-91a0-4a7da0fb5274 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:10.971711 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b8defd1a-f28f-4ad3-91a0-4a7da0fb5274 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:10.972182 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b8defd1a-f28f-4ad3-91a0-4a7da0fb5274 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:10.972943 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b8defd1a-f28f-4ad3-91a0-4a7da0fb5274 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:10.973579 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b8defd1a-f28f-4ad3-91a0-4a7da0fb5274 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:11.201113 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b8defd1a-f28f-4ad3-91a0-4a7da0fb5274 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:11.208810 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b8defd1a-f28f-4ad3-91a0-4a7da0fb5274 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1362 microversion: 2.1 time: 0.252691 May 26 14:05:11.209534 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 552/1066] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:10 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:12.227354 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a77a78a7-d184-41c7-b579-eeb7406d032f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:12.228925 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a77a78a7-d184-41c7-b579-eeb7406d032f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:12.235683 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a77a78a7-d184-41c7-b579-eeb7406d032f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:12.236669 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a77a78a7-d184-41c7-b579-eeb7406d032f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:12.237733 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a77a78a7-d184-41c7-b579-eeb7406d032f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:12.238451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a77a78a7-d184-41c7-b579-eeb7406d032f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:12.463614 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a77a78a7-d184-41c7-b579-eeb7406d032f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:12.473962 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a77a78a7-d184-41c7-b579-eeb7406d032f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1362 microversion: 2.1 time: 0.251474 May 26 14:05:12.474547 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 515/1067] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:12 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:13.491909 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7ef06898-70d8-479c-80da-fdcc5bfc6cb6 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:13.492886 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7ef06898-70d8-479c-80da-fdcc5bfc6cb6 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:13.500188 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7ef06898-70d8-479c-80da-fdcc5bfc6cb6 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:13.500633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7ef06898-70d8-479c-80da-fdcc5bfc6cb6 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:13.502136 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7ef06898-70d8-479c-80da-fdcc5bfc6cb6 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:13.502136 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7ef06898-70d8-479c-80da-fdcc5bfc6cb6 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:13.698346 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7ef06898-70d8-479c-80da-fdcc5bfc6cb6 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:13.709684 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7ef06898-70d8-479c-80da-fdcc5bfc6cb6 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1362 microversion: 2.1 time: 0.221058 May 26 14:05:13.717183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 553/1068] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:13 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:14.727735 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d30d9c17-e9ab-4996-84a5-98df463fe284 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:14.728350 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d30d9c17-e9ab-4996-84a5-98df463fe284 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:14.735140 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d30d9c17-e9ab-4996-84a5-98df463fe284 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:14.735595 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d30d9c17-e9ab-4996-84a5-98df463fe284 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:14.736369 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d30d9c17-e9ab-4996-84a5-98df463fe284 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:14.736811 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d30d9c17-e9ab-4996-84a5-98df463fe284 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:14.985752 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d30d9c17-e9ab-4996-84a5-98df463fe284 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:14.994382 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d30d9c17-e9ab-4996-84a5-98df463fe284 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1362 microversion: 2.1 time: 0.270460 May 26 14:05:14.995397 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 516/1069] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:14 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1362 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:15.440734 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-4506771e-b944-455d-9543-c13e33e83131 req-fb608d72-fda1-4efe-8b23-f49d92ffa51e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a8a362-d930-47d5-b449-fec49325ba7a", "name": "network-vif-plugged", "status": "completed", "tag": "a40f207c-1239-46bb-af6c-60ad2e69d6db"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:05:15.447282 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=6 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:05:15.454424 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-4506771e-b944-455d-9543-c13e33e83131 req-fb608d72-fda1-4efe-8b23-f49d92ffa51e service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:15.454870 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-4506771e-b944-455d-9543-c13e33e83131 req-fb608d72-fda1-4efe-8b23-f49d92ffa51e service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:15.468990 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-4506771e-b944-455d-9543-c13e33e83131 req-fb608d72-fda1-4efe-8b23-f49d92ffa51e service nova] Creating event network-vif-plugged:a40f207c-1239-46bb-af6c-60ad2e69d6db for instance 73a8a362-d930-47d5-b449-fec49325ba7a on hv-cinder-84213 May 26 14:05:15.475445 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-4506771e-b944-455d-9543-c13e33e83131 req-fb608d72-fda1-4efe-8b23-f49d92ffa51e service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038954 May 26 14:05:15.476311 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 554/1070] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:05:16.011769 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d0e9d2ea-9f0a-42b5-9bbc-41f9232c4c87 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:16.012375 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d0e9d2ea-9f0a-42b5-9bbc-41f9232c4c87 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:16.014616 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:05:16.015268 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=6 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:05:16.022331 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d0e9d2ea-9f0a-42b5-9bbc-41f9232c4c87 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:16.022779 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d0e9d2ea-9f0a-42b5-9bbc-41f9232c4c87 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:16.023604 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d0e9d2ea-9f0a-42b5-9bbc-41f9232c4c87 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:16.023985 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d0e9d2ea-9f0a-42b5-9bbc-41f9232c4c87 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:16.183705 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d0e9d2ea-9f0a-42b5-9bbc-41f9232c4c87 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:16.192847 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d0e9d2ea-9f0a-42b5-9bbc-41f9232c4c87 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1362 microversion: 2.1 time: 0.184816 May 26 14:05:16.198522 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 517/1071] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:16 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:17.211736 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cff19359-e0a9-47d9-b259-4a17112d33c9 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:17.212516 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-cff19359-e0a9-47d9-b259-4a17112d33c9 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:17.219373 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cff19359-e0a9-47d9-b259-4a17112d33c9 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:17.219819 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cff19359-e0a9-47d9-b259-4a17112d33c9 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:17.220583 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cff19359-e0a9-47d9-b259-4a17112d33c9 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:17.221013 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cff19359-e0a9-47d9-b259-4a17112d33c9 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:17.369064 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cff19359-e0a9-47d9-b259-4a17112d33c9 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:17.377182 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-cff19359-e0a9-47d9-b259-4a17112d33c9 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1362 microversion: 2.1 time: 0.170763 May 26 14:05:17.377819 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 555/1072] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:17 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:18.394121 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c17b32ec-7556-4a80-8fdb-6991f8523542 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:18.394729 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c17b32ec-7556-4a80-8fdb-6991f8523542 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:18.401177 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c17b32ec-7556-4a80-8fdb-6991f8523542 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:18.401640 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c17b32ec-7556-4a80-8fdb-6991f8523542 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:18.402400 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c17b32ec-7556-4a80-8fdb-6991f8523542 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:18.402838 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c17b32ec-7556-4a80-8fdb-6991f8523542 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:18.532771 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c17b32ec-7556-4a80-8fdb-6991f8523542 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:18.540419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c17b32ec-7556-4a80-8fdb-6991f8523542 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1548 microversion: 2.1 time: 0.150424 May 26 14:05:18.540983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 518/1073] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:18 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:18.556869 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-847eed1a-8ded-4fe2-9cad-7dda9d755a76 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:18.557414 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-847eed1a-8ded-4fe2-9cad-7dda9d755a76 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:18.564527 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-847eed1a-8ded-4fe2-9cad-7dda9d755a76 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:18.564982 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-847eed1a-8ded-4fe2-9cad-7dda9d755a76 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:18.565778 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-847eed1a-8ded-4fe2-9cad-7dda9d755a76 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:18.566218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-847eed1a-8ded-4fe2-9cad-7dda9d755a76 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:18.641433 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-847eed1a-8ded-4fe2-9cad-7dda9d755a76 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088009 May 26 14:05:18.642026 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 556/1074] 10.222.0.91 () {58 vars in 1274 bytes} [Thu May 26 14:05:18 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:05:19.542681 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-65c79ad5-302e-48ca-94b7-94f23139aa5e req-1d3ee08e-7050-4f70-b494-cc9a3ce5e3c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73a8a362-d930-47d5-b449-fec49325ba7a", "tag": "a40f207c-1239-46bb-af6c-60ad2e69d6db"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:05:19.550969 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-65c79ad5-302e-48ca-94b7-94f23139aa5e req-1d3ee08e-7050-4f70-b494-cc9a3ce5e3c1 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:19.551417 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-65c79ad5-302e-48ca-94b7-94f23139aa5e req-1d3ee08e-7050-4f70-b494-cc9a3ce5e3c1 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:19.562664 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-65c79ad5-302e-48ca-94b7-94f23139aa5e req-1d3ee08e-7050-4f70-b494-cc9a3ce5e3c1 service nova] Creating event network-changed:a40f207c-1239-46bb-af6c-60ad2e69d6db for instance 73a8a362-d930-47d5-b449-fec49325ba7a on hv-cinder-84213 May 26 14:05:19.567574 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-65c79ad5-302e-48ca-94b7-94f23139aa5e req-1d3ee08e-7050-4f70-b494-cc9a3ce5e3c1 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028587 May 26 14:05:19.568446 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 519/1075] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:05:25.547748 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4d27ee18-3d71-426c-a1ee-05424f80cf65 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:25.548590 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4d27ee18-3d71-426c-a1ee-05424f80cf65 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:25.550570 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:05:25.556308 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4d27ee18-3d71-426c-a1ee-05424f80cf65 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:25.556758 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4d27ee18-3d71-426c-a1ee-05424f80cf65 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:25.557557 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4d27ee18-3d71-426c-a1ee-05424f80cf65 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:25.557991 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4d27ee18-3d71-426c-a1ee-05424f80cf65 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:25.581564 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4d27ee18-3d71-426c-a1ee-05424f80cf65 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40/ips" status: 200 len: 150 microversion: 2.1 time: 0.038944 May 26 14:05:25.582130 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 557/1076] 10.222.0.91 () {58 vars in 1247 bytes} [Thu May 26 14:05:25 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:05:26.897110 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-27f07f99-0453-41e1-9db6-6b6acc8591d9 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39997a2e-0332-4d5d-9f3e-50e5b73127f9"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:05:26.898271 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-27f07f99-0453-41e1-9db6-6b6acc8591d9 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:26.904894 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-27f07f99-0453-41e1-9db6-6b6acc8591d9 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:26.905646 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-27f07f99-0453-41e1-9db6-6b6acc8591d9 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:26.906404 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-27f07f99-0453-41e1-9db6-6b6acc8591d9 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:26.906846 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-27f07f99-0453-41e1-9db6-6b6acc8591d9 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:27.162689 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-27f07f99-0453-41e1-9db6-6b6acc8591d9 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "POST /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270359 May 26 14:05:27.163278 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 520/1077] 10.222.0.91 () {60 vars in 1322 bytes} [Thu May 26 14:05:26 2022] POST /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:05:34.666720 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3e73ef3f-224d-4ae4-b394-eefca96be802 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39997a2e-0332-4d5d-9f3e-50e5b73127f9"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:05:34.667794 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3e73ef3f-224d-4ae4-b394-eefca96be802 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:34.673913 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e73ef3f-224d-4ae4-b394-eefca96be802 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:34.674364 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e73ef3f-224d-4ae4-b394-eefca96be802 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:34.675128 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e73ef3f-224d-4ae4-b394-eefca96be802 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:34.675567 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e73ef3f-224d-4ae4-b394-eefca96be802 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:34.679228 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=68 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:05:34.754019 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-3e73ef3f-224d-4ae4-b394-eefca96be802 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] HTTP exception thrown: Invalid volume: volume 39997a2e-0332-4d5d-9f3e-50e5b73127f9 is already attached to instances: d6c7fc24-24aa-48ea-b184-38585d2ffb40 May 26 14:05:34.755724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3e73ef3f-224d-4ae4-b394-eefca96be802 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Request method failure captured: May 26 14:05:34.755724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: POST /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40/os-volume_attachments HTTP/1.1 May 26 14:05:34.755724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 14:05:34.755724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 14:05:34.755724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 14:05:34.755724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 74 May 26 14:05:34.755724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 14:05:34.755724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 14:05:34.755724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 14:05:34.755724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 14:05:34.755724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4b__678MF1xn-Y-FCgJA6efvs1BUPOjPQR7CX8Syda7vzr5d1CdCh5DI87op5BdIZCVD07V82_W1yg69L4heAf3g2lspOZA26PnKf-_EHlLlY2PFv6bdndxAuwButuA1UEOsadDnC15207Ae7Gdf_dlN6YFnL_d6Ys4jSw91hHf8Ro May 26 14:05:34.755724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 14:05:34.755724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 14:05:34.755724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 14:05:34.755724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 14:05:34.755724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 14:05:34.755724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 14:05:34.755724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:05:34.755724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:05:34.755724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 14:05:34.755724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 14:05:34.757391 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_af9d168c40ea4df99b495eb06245d066", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:05:34.757391 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:05:34.757391 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:05:34.757391 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:05:34.757391 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:05:34.757391 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 14:05:34.757391 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 14:05:34.757391 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: 592975b43454407abde6c7cab2504982 May 26 14:05:34.757391 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:05:34.757391 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: May 26 14:05:34.757391 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {"volumeAttachment": {"volumeId": "39997a2e-0332-4d5d-9f3e-50e5b73127f9"}} May 26 14:05:34.757391 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 14:05:34.758222 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Invalid volume: volume 39997a2e-0332-4d5d-9f3e-50e5b73127f9 is already attached to instances: d6c7fc24-24aa-48ea-b184-38585d2ffb40 May 26 14:05:34.758222 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'server_id': 'd6c7fc24-24aa-48ea-b184-38585d2ffb40', 'body': {'volumeAttachment': {'volumeId': '39997a2e-0332-4d5d-9f3e-50e5b73127f9'}}} May 26 14:05:34.758222 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:05:34.758222 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:05:34.758222 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 14:05:34.758222 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 14:05:34.758222 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 14:05:34.758222 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 14:05:34.758222 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 14:05:34.758222 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 14:05:34.758222 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 14:05:34.758222 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 14:05:34.758222 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 14:05:34.758222 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 14:05:34.758222 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 39997a2e-0332-4d5d-9f3e-50e5b73127f9 is already attached to instances: d6c7fc24-24aa-48ea-b184-38585d2ffb40 May 26 14:05:34.758222 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:05:34.758222 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:05:34.758222 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:05:34.758222 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:05:34.759781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:05:34.759781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:05:34.759781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:05:34.759781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:05:34.759781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:05:34.759781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:05:34.759781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 14:05:34.759781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 14:05:34.759781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 14:05:34.759781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 14:05:34.759781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 14:05:34.759781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 14:05:34.759781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 14:05:34.759781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 14:05:34.759781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 39997a2e-0332-4d5d-9f3e-50e5b73127f9 is already attached to instances: d6c7fc24-24aa-48ea-b184-38585d2ffb40 May 26 14:05:34.759781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:05:34.759781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:05:34.759781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:05:34.759781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:05:34.759781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:05:34.761371 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:05:34.761371 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:05:34.761371 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:05:34.761371 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 39997a2e-0332-4d5d-9f3e-50e5b73127f9 is already attached to instances: d6c7fc24-24aa-48ea-b184-38585d2ffb40 May 26 14:05:34.761371 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:05:34.761371 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3e73ef3f-224d-4ae4-b394-eefca96be802 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Returning 400 to user: Invalid volume: volume 39997a2e-0332-4d5d-9f3e-50e5b73127f9 is already attached to instances: d6c7fc24-24aa-48ea-b184-38585d2ffb40 {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:05:34.761371 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3e73ef3f-224d-4ae4-b394-eefca96be802 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "POST /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094707 May 26 14:05:34.761371 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 558/1078] 10.222.0.91 () {60 vars in 1322 bytes} [Thu May 26 14:05:34 2022] POST /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 14:05:34.819334 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-52a38f83-809e-4886-a5e7-943a77ab14c4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:34.820088 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-52a38f83-809e-4886-a5e7-943a77ab14c4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:34.822343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:05:34.828381 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-52a38f83-809e-4886-a5e7-943a77ab14c4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:34.828836 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-52a38f83-809e-4886-a5e7-943a77ab14c4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:34.829641 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-52a38f83-809e-4886-a5e7-943a77ab14c4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:34.830081 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-52a38f83-809e-4886-a5e7-943a77ab14c4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:34.916242 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-52a38f83-809e-4886-a5e7-943a77ab14c4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lazy-loading 'services' on Instance uuid d6c7fc24-24aa-48ea-b184-38585d2ffb40 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:05:34.986428 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-52a38f83-809e-4886-a5e7-943a77ab14c4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "DELETE /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40/os-volume_attachments/39997a2e-0332-4d5d-9f3e-50e5b73127f9" status: 202 len: 0 microversion: 2.1 time: 0.171930 May 26 14:05:34.987033 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 521/1079] 10.222.0.91 () {58 vars in 1415 bytes} [Thu May 26 14:05:34 2022] DELETE /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40/os-volume_attachments/39997a2e-0332-4d5d-9f3e-50e5b73127f9 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:05:34.996323 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f97ff0f0-9a8f-4d84-a6b0-d14f3d8d52ce tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:34.997344 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f97ff0f0-9a8f-4d84-a6b0-d14f3d8d52ce tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:35.003375 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f97ff0f0-9a8f-4d84-a6b0-d14f3d8d52ce tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:35.003819 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f97ff0f0-9a8f-4d84-a6b0-d14f3d8d52ce tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:35.004580 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f97ff0f0-9a8f-4d84-a6b0-d14f3d8d52ce tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:35.005055 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f97ff0f0-9a8f-4d84-a6b0-d14f3d8d52ce tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:35.042112 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f97ff0f0-9a8f-4d84-a6b0-d14f3d8d52ce tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050644 May 26 14:05:35.042661 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 559/1080] 10.222.0.91 () {58 vars in 1301 bytes} [Thu May 26 14:05:34 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:05:36.054678 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bee6deae-b906-451b-8be0-3a0c0be0e384 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:36.055778 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bee6deae-b906-451b-8be0-3a0c0be0e384 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:36.062024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bee6deae-b906-451b-8be0-3a0c0be0e384 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:36.062478 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bee6deae-b906-451b-8be0-3a0c0be0e384 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:36.063243 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bee6deae-b906-451b-8be0-3a0c0be0e384 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:36.063684 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bee6deae-b906-451b-8be0-3a0c0be0e384 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:36.093065 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bee6deae-b906-451b-8be0-3a0c0be0e384 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042999 May 26 14:05:36.093640 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 522/1081] 10.222.0.91 () {58 vars in 1301 bytes} [Thu May 26 14:05:36 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 14:05:36.151919 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d70ad445-ee8f-4aa3-91b4-bbc46d4e3b43 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:36.152449 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d70ad445-ee8f-4aa3-91b4-bbc46d4e3b43 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:36.159771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d70ad445-ee8f-4aa3-91b4-bbc46d4e3b43 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:36.160212 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d70ad445-ee8f-4aa3-91b4-bbc46d4e3b43 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:36.160972 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d70ad445-ee8f-4aa3-91b4-bbc46d4e3b43 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:36.161421 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d70ad445-ee8f-4aa3-91b4-bbc46d4e3b43 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:36.186315 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d70ad445-ee8f-4aa3-91b4-bbc46d4e3b43 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 14:05:36.259908 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d70ad445-ee8f-4aa3-91b4-bbc46d4e3b43 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "DELETE /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 204 len: 0 microversion: 2.1 time: 0.111573 May 26 14:05:36.260728 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 560/1082] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 14:05:36 2022] DELETE /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 14:05:36.270676 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4b456efd-c0f6-42ec-8b7f-ec084ad2047b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:36.271442 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4b456efd-c0f6-42ec-8b7f-ec084ad2047b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:36.277467 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4b456efd-c0f6-42ec-8b7f-ec084ad2047b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:36.277927 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4b456efd-c0f6-42ec-8b7f-ec084ad2047b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:36.279307 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4b456efd-c0f6-42ec-8b7f-ec084ad2047b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:36.279745 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4b456efd-c0f6-42ec-8b7f-ec084ad2047b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:36.408412 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4b456efd-c0f6-42ec-8b7f-ec084ad2047b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:36.415873 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4b456efd-c0f6-42ec-8b7f-ec084ad2047b tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 200 len: 1682 microversion: 2.1 time: 0.150427 May 26 14:05:36.416439 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 523/1083] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:36 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:37.434002 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f1f06564-fd3f-474a-9116-bbdd7e87c3cb tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:37.434740 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f1f06564-fd3f-474a-9116-bbdd7e87c3cb tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:37.441191 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1f06564-fd3f-474a-9116-bbdd7e87c3cb tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:37.441648 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1f06564-fd3f-474a-9116-bbdd7e87c3cb tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:37.442418 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1f06564-fd3f-474a-9116-bbdd7e87c3cb tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:37.442856 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1f06564-fd3f-474a-9116-bbdd7e87c3cb tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:37.569840 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f1f06564-fd3f-474a-9116-bbdd7e87c3cb tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:37.577930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f1f06564-fd3f-474a-9116-bbdd7e87c3cb tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 200 len: 1682 microversion: 2.1 time: 0.148181 May 26 14:05:37.578498 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 561/1084] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:37 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:38.595515 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0309b8ff-4596-4199-ace9-0f080ccac6fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:38.596124 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0309b8ff-4596-4199-ace9-0f080ccac6fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:38.602833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0309b8ff-4596-4199-ace9-0f080ccac6fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:38.603290 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0309b8ff-4596-4199-ace9-0f080ccac6fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:38.604060 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0309b8ff-4596-4199-ace9-0f080ccac6fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:38.604500 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0309b8ff-4596-4199-ace9-0f080ccac6fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:38.608611 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:05:38.753640 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0309b8ff-4596-4199-ace9-0f080ccac6fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:38.761259 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0309b8ff-4596-4199-ace9-0f080ccac6fa tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 200 len: 1682 microversion: 2.1 time: 0.170177 May 26 14:05:38.761763 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 524/1085] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:38 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:39.305068 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-56be0180-b8cb-4f4e-90fc-73ca5c492292 req-ef45f974-0504-49d4-bf1b-ed5117117881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c7fc24-24aa-48ea-b184-38585d2ffb40", "name": "network-vif-deleted", "tag": "36211193-9c2e-4666-9039-2f26d4b7c02d"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:05:39.313826 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-56be0180-b8cb-4f4e-90fc-73ca5c492292 req-ef45f974-0504-49d4-bf1b-ed5117117881 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:39.314349 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-56be0180-b8cb-4f4e-90fc-73ca5c492292 req-ef45f974-0504-49d4-bf1b-ed5117117881 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:39.325958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-56be0180-b8cb-4f4e-90fc-73ca5c492292 req-ef45f974-0504-49d4-bf1b-ed5117117881 service nova] Creating event network-vif-deleted:36211193-9c2e-4666-9039-2f26d4b7c02d for instance d6c7fc24-24aa-48ea-b184-38585d2ffb40 on hv-cinder-84213 May 26 14:05:39.330688 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-56be0180-b8cb-4f4e-90fc-73ca5c492292 req-ef45f974-0504-49d4-bf1b-ed5117117881 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029278 May 26 14:05:39.331598 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 562/1086] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:05:39.779063 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b03bcdd6-469f-4fb8-9cd9-23188b0e0816 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:39.779761 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b03bcdd6-469f-4fb8-9cd9-23188b0e0816 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:39.786332 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b03bcdd6-469f-4fb8-9cd9-23188b0e0816 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:39.786786 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b03bcdd6-469f-4fb8-9cd9-23188b0e0816 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:39.787715 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b03bcdd6-469f-4fb8-9cd9-23188b0e0816 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:39.788003 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b03bcdd6-469f-4fb8-9cd9-23188b0e0816 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:39.822098 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b03bcdd6-469f-4fb8-9cd9-23188b0e0816 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:39.822550 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b03bcdd6-469f-4fb8-9cd9-23188b0e0816 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:39.823001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-b03bcdd6-469f-4fb8-9cd9-23188b0e0816 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lazy-loading 'fault' on Instance uuid d6c7fc24-24aa-48ea-b184-38585d2ffb40 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:05:39.867679 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b03bcdd6-469f-4fb8-9cd9-23188b0e0816 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:39.876468 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b03bcdd6-469f-4fb8-9cd9-23188b0e0816 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 200 len: 1331 microversion: 2.1 time: 0.101250 May 26 14:05:39.877019 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 525/1087] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:39 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:40.894513 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8c19ab01-af41-4c7b-b11d-3b8282ae5f75 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:40.895199 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8c19ab01-af41-4c7b-b11d-3b8282ae5f75 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:40.903996 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8c19ab01-af41-4c7b-b11d-3b8282ae5f75 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:40.904448 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8c19ab01-af41-4c7b-b11d-3b8282ae5f75 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:40.905300 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8c19ab01-af41-4c7b-b11d-3b8282ae5f75 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:40.905734 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8c19ab01-af41-4c7b-b11d-3b8282ae5f75 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:40.918561 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-8c19ab01-af41-4c7b-b11d-3b8282ae5f75 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] HTTP exception thrown: Instance d6c7fc24-24aa-48ea-b184-38585d2ffb40 could not be found. May 26 14:05:40.920185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8c19ab01-af41-4c7b-b11d-3b8282ae5f75 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Request method failure captured: May 26 14:05:40.920185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 HTTP/1.1 May 26 14:05:40.920185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 14:05:40.920185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 14:05:40.920185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 14:05:40.920185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 14:05:40.920185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 14:05:40.920185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 14:05:40.920185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 14:05:40.920185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 14:05:40.920185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4b__678MF1xn-Y-FCgJA6efvs1BUPOjPQR7CX8Syda7vzr5d1CdCh5DI87op5BdIZCVD07V82_W1yg69L4heAf3g2lspOZA26PnKf-_EHlLlY2PFv6bdndxAuwButuA1UEOsadDnC15207Ae7Gdf_dlN6YFnL_d6Ys4jSw91hHf8Ro May 26 14:05:40.920185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 14:05:40.920185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 14:05:40.920185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 14:05:40.920185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 14:05:40.920185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 14:05:40.920185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 14:05:40.920185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:05:40.920185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:05:40.920185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 14:05:40.920185 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 14:05:40.921657 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_af9d168c40ea4df99b495eb06245d066", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:05:40.921657 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:05:40.921657 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:05:40.921657 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:05:40.921657 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:05:40.921657 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 14:05:40.921657 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 14:05:40.921657 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: 592975b43454407abde6c7cab2504982 May 26 14:05:40.921657 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:05:40.921657 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 14:05:40.921657 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Instance d6c7fc24-24aa-48ea-b184-38585d2ffb40 could not be found. May 26 14:05:40.921657 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': 'd6c7fc24-24aa-48ea-b184-38585d2ffb40'} May 26 14:05:40.922420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:05:40.922420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:05:40.922420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:05:40.922420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:05:40.922420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:05:40.922420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:05:40.922420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:05:40.922420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:05:40.922420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:05:40.922420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:05:40.922420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6c7fc24-24aa-48ea-b184-38585d2ffb40 could not be found. May 26 14:05:40.922420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:05:40.922420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:05:40.922420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:05:40.922420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:05:40.922420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:05:40.922420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:05:40.922420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:05:40.922420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:05:40.922420 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:05:40.923874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:05:40.923874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:05:40.923874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:05:40.923874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:05:40.923874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:05:40.923874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:05:40.923874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:05:40.923874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6c7fc24-24aa-48ea-b184-38585d2ffb40 could not be found. May 26 14:05:40.923874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:05:40.923874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:05:40.923874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:05:40.923874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:05:40.923874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:05:40.923874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:05:40.923874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:05:40.923874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:05:40.923874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6c7fc24-24aa-48ea-b184-38585d2ffb40 could not be found. May 26 14:05:40.923874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:05:40.925223 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8c19ab01-af41-4c7b-b11d-3b8282ae5f75 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Returning 404 to user: Instance d6c7fc24-24aa-48ea-b184-38585d2ffb40 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:05:40.925223 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8c19ab01-af41-4c7b-b11d-3b8282ae5f75 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 404 len: 111 microversion: 2.1 time: 0.031440 May 26 14:05:40.925223 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 563/1088] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:40 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:05:40.930355 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c17a41d1-b1d7-4da1-815a-1c8855436478 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '.version_select at 0x7f25a4d101f0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:40.947349 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c17a41d1-b1d7-4da1-815a-1c8855436478 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1515242531" status: 202 len: 0 microversion: 2.1 time: 0.020677 May 26 14:05:40.947909 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 526/1089] 10.222.0.91 () {58 vars in 1220 bytes} [Thu May 26 14:05:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1515242531 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:05:41.545580 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5125ad81-4a93-4664-a380-6609020856d6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Action: 'create', calling method: .version_select at 0x7f25a4b50040>, body: {"keypair": {"name": "tempest-keypair-1248733314", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPl3pNYz54X/9EEKOqoJXNu2WWo/EK7F8o10pNw10oZVPbL70rEBux7IHoS2k94wgK7HcVHrEfCVPZRuusminNTf0C6ZzXjpB7ni1pWQ6E8vci/fvlybuZDJfrYDplyAvA=="}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:05:41.559891 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-5125ad81-4a93-4664-a380-6609020856d6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Getting quotas for project af9d168c40ea4df99b495eb06245d066. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 14:05:41.563637 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-5125ad81-4a93-4664-a380-6609020856d6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Getting quotas for user 592975b43454407abde6c7cab2504982 and project af9d168c40ea4df99b495eb06245d066. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 14:05:41.585835 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5125ad81-4a93-4664-a380-6609020856d6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044229 May 26 14:05:41.586454 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 564/1090] 10.222.0.91 () {60 vars in 1158 bytes} [Thu May 26 14:05:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:05:43.058597 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-61e6d279-40e7-4084-ac61-993f801eab1c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-880672541", "imageRef": "bcaacfae-fe2c-455f-a6e1-b08361c6fa8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f7e5c2e-dcd0-44c0-a251-a7bcffefb292"}], "security_groups": [{"name": "tempest-securitygroup--2064828826"}], "key_name": "tempest-keypair-1248733314", "user_data": "}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:05:43.163257 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-61e6d279-40e7-4084-ac61-993f801eab1c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] validate_networks() for [('5f7e5c2e-dcd0-44c0-a251-a7bcffefb292', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 14:05:43.786596 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-61e6d279-40e7-4084-ac61-993f801eab1c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 14:05:43.787021 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-61e6d279-40e7-4084-ac61-993f801eab1c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 14:05:43.787489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-61e6d279-40e7-4084-ac61-993f801eab1c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 14:05:43.787895 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-61e6d279-40e7-4084-ac61-993f801eab1c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 14:05:43.788301 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-61e6d279-40e7-4084-ac61-993f801eab1c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 14:05:43.797018 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-61e6d279-40e7-4084-ac61-993f801eab1c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:43.797494 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-61e6d279-40e7-4084-ac61-993f801eab1c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:43.798287 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-61e6d279-40e7-4084-ac61-993f801eab1c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:43.798722 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-61e6d279-40e7-4084-ac61-993f801eab1c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:43.815512 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-61e6d279-40e7-4084-ac61-993f801eab1c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Getting quotas for project af9d168c40ea4df99b495eb06245d066. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 14:05:43.820427 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-61e6d279-40e7-4084-ac61-993f801eab1c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Getting quotas for user 592975b43454407abde6c7cab2504982 and project af9d168c40ea4df99b495eb06245d066. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 14:05:43.833445 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-61e6d279-40e7-4084-ac61-993f801eab1c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 14:05:43.835743 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-61e6d279-40e7-4084-ac61-993f801eab1c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bcaacfae-fe2c-455f-a6e1-b08361c6fa8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 14:05:43.882147 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-61e6d279-40e7-4084-ac61-993f801eab1c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.828319 May 26 14:05:43.882813 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 527/1091] 10.222.0.91 () {60 vars in 1146 bytes} [Thu May 26 14:05:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 14:05:43.893557 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ad5b1699-6d06-44cf-a869-ae4a671e4235 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:43.894167 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ad5b1699-6d06-44cf-a869-ae4a671e4235 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:43.949085 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ad5b1699-6d06-44cf-a869-ae4a671e4235 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:43.956308 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ad5b1699-6d06-44cf-a869-ae4a671e4235 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d" status: 200 len: 1241 microversion: 2.1 time: 0.067446 May 26 14:05:43.956874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 565/1092] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:43 2022] GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:44.975929 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cf5f79e5-ef7c-448f-ae49-466773d44e69 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:44.975929 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cf5f79e5-ef7c-448f-ae49-466773d44e69 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:44.983990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cf5f79e5-ef7c-448f-ae49-466773d44e69 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:44.984437 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cf5f79e5-ef7c-448f-ae49-466773d44e69 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:44.986606 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cf5f79e5-ef7c-448f-ae49-466773d44e69 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:44.987069 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cf5f79e5-ef7c-448f-ae49-466773d44e69 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:45.060087 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cf5f79e5-ef7c-448f-ae49-466773d44e69 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:45.069056 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cf5f79e5-ef7c-448f-ae49-466773d44e69 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d" status: 200 len: 1311 microversion: 2.1 time: 0.098914 May 26 14:05:45.069743 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 528/1093] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:44 2022] GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:46.085327 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-13542379-46ff-48b8-83a5-d72a668c96ce tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:46.086094 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-13542379-46ff-48b8-83a5-d72a668c96ce tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:46.093334 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-13542379-46ff-48b8-83a5-d72a668c96ce tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:46.093779 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-13542379-46ff-48b8-83a5-d72a668c96ce tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:46.094641 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-13542379-46ff-48b8-83a5-d72a668c96ce tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:46.095084 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-13542379-46ff-48b8-83a5-d72a668c96ce tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:46.238707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-13542379-46ff-48b8-83a5-d72a668c96ce tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:46.246779 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-13542379-46ff-48b8-83a5-d72a668c96ce tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d" status: 200 len: 1367 microversion: 2.1 time: 0.165257 May 26 14:05:46.247374 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 566/1094] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:46 2022] GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:46.453648 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-116ff753-130c-4400-b82e-8e2e0dfde93d req-5062c8ea-9a97-44f5-bfef-1b5b429328b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70afcd8b-ecce-41cf-9d39-8f7484bdb65d", "tag": "197365b1-d8da-490a-8a26-789f87b83be2"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:05:46.467658 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-116ff753-130c-4400-b82e-8e2e0dfde93d req-5062c8ea-9a97-44f5-bfef-1b5b429328b2 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:46.468342 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-116ff753-130c-4400-b82e-8e2e0dfde93d req-5062c8ea-9a97-44f5-bfef-1b5b429328b2 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:46.480033 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-116ff753-130c-4400-b82e-8e2e0dfde93d req-5062c8ea-9a97-44f5-bfef-1b5b429328b2 service nova] Creating event network-changed:197365b1-d8da-490a-8a26-789f87b83be2 for instance 70afcd8b-ecce-41cf-9d39-8f7484bdb65d on hv-cinder-84213 May 26 14:05:46.485556 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-116ff753-130c-4400-b82e-8e2e0dfde93d req-5062c8ea-9a97-44f5-bfef-1b5b429328b2 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036098 May 26 14:05:46.486489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 529/1095] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:05:47.264583 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f16e3351-9df5-4794-bf19-6f8a2d417bd5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:47.265411 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f16e3351-9df5-4794-bf19-6f8a2d417bd5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:47.271886 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f16e3351-9df5-4794-bf19-6f8a2d417bd5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:47.272336 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f16e3351-9df5-4794-bf19-6f8a2d417bd5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:47.273105 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f16e3351-9df5-4794-bf19-6f8a2d417bd5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:47.273594 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f16e3351-9df5-4794-bf19-6f8a2d417bd5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:47.400702 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f16e3351-9df5-4794-bf19-6f8a2d417bd5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:47.408256 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f16e3351-9df5-4794-bf19-6f8a2d417bd5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d" status: 200 len: 1367 microversion: 2.1 time: 0.148385 May 26 14:05:47.408818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 567/1096] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:47 2022] GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:48.425787 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-effe39c8-26ac-40dd-a851-b4cd455b7306 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:48.426485 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-effe39c8-26ac-40dd-a851-b4cd455b7306 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:48.432974 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-effe39c8-26ac-40dd-a851-b4cd455b7306 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:48.434178 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-effe39c8-26ac-40dd-a851-b4cd455b7306 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:48.434995 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-effe39c8-26ac-40dd-a851-b4cd455b7306 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:48.435446 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-effe39c8-26ac-40dd-a851-b4cd455b7306 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:48.565437 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-effe39c8-26ac-40dd-a851-b4cd455b7306 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:48.572878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-effe39c8-26ac-40dd-a851-b4cd455b7306 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d" status: 200 len: 1367 microversion: 2.1 time: 0.152085 May 26 14:05:48.573489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 530/1097] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:48 2022] GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:49.590614 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-85b7c745-10ff-450b-8bac-f8ce9a7ff7c9 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:49.592796 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-85b7c745-10ff-450b-8bac-f8ce9a7ff7c9 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:49.599688 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-85b7c745-10ff-450b-8bac-f8ce9a7ff7c9 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:49.600130 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-85b7c745-10ff-450b-8bac-f8ce9a7ff7c9 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:49.600918 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-85b7c745-10ff-450b-8bac-f8ce9a7ff7c9 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:49.601372 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-85b7c745-10ff-450b-8bac-f8ce9a7ff7c9 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:49.730361 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-85b7c745-10ff-450b-8bac-f8ce9a7ff7c9 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:49.737939 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-85b7c745-10ff-450b-8bac-f8ce9a7ff7c9 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d" status: 200 len: 1367 microversion: 2.1 time: 0.151227 May 26 14:05:49.738505 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 568/1098] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:49 2022] GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:50.754850 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-502fa01b-88cf-470a-9703-d6fd651a4fc3 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:50.755438 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-502fa01b-88cf-470a-9703-d6fd651a4fc3 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:50.761930 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-502fa01b-88cf-470a-9703-d6fd651a4fc3 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:50.762404 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-502fa01b-88cf-470a-9703-d6fd651a4fc3 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:50.763156 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-502fa01b-88cf-470a-9703-d6fd651a4fc3 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:50.763615 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-502fa01b-88cf-470a-9703-d6fd651a4fc3 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:50.891782 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-502fa01b-88cf-470a-9703-d6fd651a4fc3 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:50.899048 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-502fa01b-88cf-470a-9703-d6fd651a4fc3 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d" status: 200 len: 1367 microversion: 2.1 time: 0.148149 May 26 14:05:50.899617 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 531/1099] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:50 2022] GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:51.473511 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-efa70c03-c9dc-496f-b1bb-5354d66fa3df req-fc5e350d-aca2-4d39-84c2-b3914e6e8f20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70afcd8b-ecce-41cf-9d39-8f7484bdb65d", "name": "network-vif-plugged", "status": "completed", "tag": "197365b1-d8da-490a-8a26-789f87b83be2"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:05:51.482234 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-efa70c03-c9dc-496f-b1bb-5354d66fa3df req-fc5e350d-aca2-4d39-84c2-b3914e6e8f20 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:51.482899 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-efa70c03-c9dc-496f-b1bb-5354d66fa3df req-fc5e350d-aca2-4d39-84c2-b3914e6e8f20 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:51.495069 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-efa70c03-c9dc-496f-b1bb-5354d66fa3df req-fc5e350d-aca2-4d39-84c2-b3914e6e8f20 service nova] Creating event network-vif-plugged:197365b1-d8da-490a-8a26-789f87b83be2 for instance 70afcd8b-ecce-41cf-9d39-8f7484bdb65d on hv-cinder-84213 May 26 14:05:51.500569 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-efa70c03-c9dc-496f-b1bb-5354d66fa3df req-fc5e350d-aca2-4d39-84c2-b3914e6e8f20 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030701 May 26 14:05:51.501433 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 569/1100] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:05:51.916098 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a7420745-881d-45d2-aecf-faa3539b4d88 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:51.916705 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a7420745-881d-45d2-aecf-faa3539b4d88 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:51.923844 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a7420745-881d-45d2-aecf-faa3539b4d88 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:51.924291 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a7420745-881d-45d2-aecf-faa3539b4d88 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:51.925068 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a7420745-881d-45d2-aecf-faa3539b4d88 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:51.925538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a7420745-881d-45d2-aecf-faa3539b4d88 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:52.052038 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a7420745-881d-45d2-aecf-faa3539b4d88 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:52.059698 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a7420745-881d-45d2-aecf-faa3539b4d88 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d" status: 200 len: 1367 microversion: 2.1 time: 0.147383 May 26 14:05:52.060298 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 532/1101] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:51 2022] GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:52.575616 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4c8d5817-0a1c-4e3f-9106-0f47b121ff3c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:52.576221 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4c8d5817-0a1c-4e3f-9106-0f47b121ff3c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:52.582491 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4c8d5817-0a1c-4e3f-9106-0f47b121ff3c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:52.582931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4c8d5817-0a1c-4e3f-9106-0f47b121ff3c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:52.583680 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4c8d5817-0a1c-4e3f-9106-0f47b121ff3c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:52.584111 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4c8d5817-0a1c-4e3f-9106-0f47b121ff3c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:52.608081 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4c8d5817-0a1c-4e3f-9106-0f47b121ff3c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7/ips" status: 200 len: 150 microversion: 2.20 time: 0.036872 May 26 14:05:52.608700 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 570/1102] 10.222.0.91 () {60 vars in 1288 bytes} [Thu May 26 14:05:52 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:05:53.077286 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-56728001-da56-4c76-b36d-cc4df16f8749 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:53.077902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-56728001-da56-4c76-b36d-cc4df16f8749 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:53.084841 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-56728001-da56-4c76-b36d-cc4df16f8749 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:53.085334 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-56728001-da56-4c76-b36d-cc4df16f8749 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:53.086110 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-56728001-da56-4c76-b36d-cc4df16f8749 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:53.086549 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-56728001-da56-4c76-b36d-cc4df16f8749 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:53.219633 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-56728001-da56-4c76-b36d-cc4df16f8749 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:53.227296 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-56728001-da56-4c76-b36d-cc4df16f8749 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d" status: 200 len: 1367 microversion: 2.1 time: 0.154563 May 26 14:05:53.228077 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 533/1103] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:53 2022] GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:05:54.243916 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7f5238e5-a571-471f-b560-87d6316670af tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:54.244523 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7f5238e5-a571-471f-b560-87d6316670af tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:54.246962 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=6 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:05:54.252306 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f5238e5-a571-471f-b560-87d6316670af tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:54.252754 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f5238e5-a571-471f-b560-87d6316670af tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:54.253537 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f5238e5-a571-471f-b560-87d6316670af tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:54.253968 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f5238e5-a571-471f-b560-87d6316670af tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:54.388129 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7f5238e5-a571-471f-b560-87d6316670af tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:54.392947 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d5d74acb-78cb-4024-8bbc-4f287275349f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:05:54.393514 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d5d74acb-78cb-4024-8bbc-4f287275349f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:54.395685 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:05:54.396456 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=6 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:05:54.396644 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7f5238e5-a571-471f-b560-87d6316670af tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d" status: 200 len: 1558 microversion: 2.1 time: 0.156442 May 26 14:05:54.397330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 571/1104] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:05:54 2022] GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:05:54.403054 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d5d74acb-78cb-4024-8bbc-4f287275349f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:54.403054 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d5d74acb-78cb-4024-8bbc-4f287275349f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:54.403794 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d5d74acb-78cb-4024-8bbc-4f287275349f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:54.404894 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d5d74acb-78cb-4024-8bbc-4f287275349f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:54.413582 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-977360cd-42a3-4d27-91aa-fd6c4765d2ac tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:54.414173 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-977360cd-42a3-4d27-91aa-fd6c4765d2ac tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:54.423917 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-977360cd-42a3-4d27-91aa-fd6c4765d2ac tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:54.424604 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-977360cd-42a3-4d27-91aa-fd6c4765d2ac tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:54.425977 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-977360cd-42a3-4d27-91aa-fd6c4765d2ac tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:54.426651 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-977360cd-42a3-4d27-91aa-fd6c4765d2ac tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:54.429899 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-d5d74acb-78cb-4024-8bbc-4f287275349f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lazy-loading 'flavor' on Instance uuid 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:05:54.505564 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-977360cd-42a3-4d27-91aa-fd6c4765d2ac tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095740 May 26 14:05:54.506188 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 572/1105] 10.222.0.91 () {58 vars in 1274 bytes} [Thu May 26 14:05:54 2022] GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:05:54.704820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d5d74acb-78cb-4024-8bbc-4f287275349f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "POST /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7/action" status: 202 len: 0 microversion: 2.20 time: 0.316344 May 26 14:05:54.705481 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 534/1106] 10.222.0.91 () {62 vars in 1318 bytes} [Thu May 26 14:05:54 2022] POST /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 26 14:05:54.714941 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f35e9121-3c95-4365-b918-92de576ae56b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:54.716037 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f35e9121-3c95-4365-b918-92de576ae56b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:54.723816 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f35e9121-3c95-4365-b918-92de576ae56b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:54.724400 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f35e9121-3c95-4365-b918-92de576ae56b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:54.725345 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f35e9121-3c95-4365-b918-92de576ae56b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:54.725803 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f35e9121-3c95-4365-b918-92de576ae56b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:54.864589 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f35e9121-3c95-4365-b918-92de576ae56b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:54.873541 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f35e9121-3c95-4365-b918-92de576ae56b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:54.874581 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f35e9121-3c95-4365-b918-92de576ae56b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:54.875741 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f35e9121-3c95-4365-b918-92de576ae56b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1720 microversion: 2.20 time: 0.166066 May 26 14:05:54.876297 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 573/1107] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:05:54 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:05:55.426234 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-323df561-e9d7-4bbf-beb7-db337cda599f req-5e732aa0-aba9-456a-99ae-8063238f0c25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70afcd8b-ecce-41cf-9d39-8f7484bdb65d", "tag": "197365b1-d8da-490a-8a26-789f87b83be2"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:05:55.434661 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-323df561-e9d7-4bbf-beb7-db337cda599f req-5e732aa0-aba9-456a-99ae-8063238f0c25 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:55.435208 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-323df561-e9d7-4bbf-beb7-db337cda599f req-5e732aa0-aba9-456a-99ae-8063238f0c25 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:55.446023 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-323df561-e9d7-4bbf-beb7-db337cda599f req-5e732aa0-aba9-456a-99ae-8063238f0c25 service nova] Creating event network-changed:197365b1-d8da-490a-8a26-789f87b83be2 for instance 70afcd8b-ecce-41cf-9d39-8f7484bdb65d on hv-cinder-84213 May 26 14:05:55.450833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-323df561-e9d7-4bbf-beb7-db337cda599f req-5e732aa0-aba9-456a-99ae-8063238f0c25 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028996 May 26 14:05:55.451439 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 535/1108] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:05:55.895186 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-07e94379-fa56-4b46-84ab-897d16cca996 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:55.895924 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-07e94379-fa56-4b46-84ab-897d16cca996 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:55.898808 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:05:55.905594 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-07e94379-fa56-4b46-84ab-897d16cca996 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:55.906232 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-07e94379-fa56-4b46-84ab-897d16cca996 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:55.907194 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-07e94379-fa56-4b46-84ab-897d16cca996 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:55.907838 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-07e94379-fa56-4b46-84ab-897d16cca996 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:56.060970 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-07e94379-fa56-4b46-84ab-897d16cca996 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:56.068938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-07e94379-fa56-4b46-84ab-897d16cca996 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:56.070480 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-07e94379-fa56-4b46-84ab-897d16cca996 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:56.071644 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-07e94379-fa56-4b46-84ab-897d16cca996 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1720 microversion: 2.20 time: 0.180598 May 26 14:05:56.072204 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 574/1109] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:05:55 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:05:57.091630 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b71ffd2e-14fd-45b8-9714-0d4cc27c035c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:57.092338 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b71ffd2e-14fd-45b8-9714-0d4cc27c035c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:57.099648 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b71ffd2e-14fd-45b8-9714-0d4cc27c035c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:57.100092 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b71ffd2e-14fd-45b8-9714-0d4cc27c035c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:57.100868 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b71ffd2e-14fd-45b8-9714-0d4cc27c035c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:57.101334 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b71ffd2e-14fd-45b8-9714-0d4cc27c035c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:57.238830 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b71ffd2e-14fd-45b8-9714-0d4cc27c035c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:57.247698 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b71ffd2e-14fd-45b8-9714-0d4cc27c035c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:57.249844 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b71ffd2e-14fd-45b8-9714-0d4cc27c035c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:57.251021 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b71ffd2e-14fd-45b8-9714-0d4cc27c035c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1720 microversion: 2.20 time: 0.164133 May 26 14:05:57.251579 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 536/1110] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:05:57 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:05:58.270194 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-91ec5b76-0a4f-4916-a563-c7a1ba15845b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:58.270799 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-91ec5b76-0a4f-4916-a563-c7a1ba15845b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:58.277049 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-91ec5b76-0a4f-4916-a563-c7a1ba15845b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:58.277583 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-91ec5b76-0a4f-4916-a563-c7a1ba15845b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:58.278349 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-91ec5b76-0a4f-4916-a563-c7a1ba15845b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:58.278784 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-91ec5b76-0a4f-4916-a563-c7a1ba15845b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:58.408837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-91ec5b76-0a4f-4916-a563-c7a1ba15845b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:58.416775 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-91ec5b76-0a4f-4916-a563-c7a1ba15845b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:58.418317 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-91ec5b76-0a4f-4916-a563-c7a1ba15845b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:58.419481 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-91ec5b76-0a4f-4916-a563-c7a1ba15845b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1720 microversion: 2.20 time: 0.153213 May 26 14:05:58.420032 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 575/1111] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:05:58 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:05:59.437678 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cce4c1da-239d-46f9-b79a-2ed6d87a5693 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:05:59.438325 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cce4c1da-239d-46f9-b79a-2ed6d87a5693 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:05:59.445101 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cce4c1da-239d-46f9-b79a-2ed6d87a5693 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:59.445589 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cce4c1da-239d-46f9-b79a-2ed6d87a5693 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:59.446355 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cce4c1da-239d-46f9-b79a-2ed6d87a5693 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:05:59.446795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cce4c1da-239d-46f9-b79a-2ed6d87a5693 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:05:59.575122 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cce4c1da-239d-46f9-b79a-2ed6d87a5693 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:59.583470 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cce4c1da-239d-46f9-b79a-2ed6d87a5693 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:59.584977 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cce4c1da-239d-46f9-b79a-2ed6d87a5693 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:05:59.586165 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cce4c1da-239d-46f9-b79a-2ed6d87a5693 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1720 microversion: 2.20 time: 0.152534 May 26 14:05:59.586729 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 537/1112] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:05:59 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:00.604329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9939af6c-0595-4a6a-a7af-ba3ac937931b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:00.604932 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9939af6c-0595-4a6a-a7af-ba3ac937931b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:00.612105 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9939af6c-0595-4a6a-a7af-ba3ac937931b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:00.612555 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9939af6c-0595-4a6a-a7af-ba3ac937931b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:00.613347 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9939af6c-0595-4a6a-a7af-ba3ac937931b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:00.613783 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9939af6c-0595-4a6a-a7af-ba3ac937931b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:00.742303 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9939af6c-0595-4a6a-a7af-ba3ac937931b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:00.750164 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9939af6c-0595-4a6a-a7af-ba3ac937931b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:00.751673 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9939af6c-0595-4a6a-a7af-ba3ac937931b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:00.752827 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9939af6c-0595-4a6a-a7af-ba3ac937931b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1720 microversion: 2.20 time: 0.152385 May 26 14:06:00.753415 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 576/1113] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:00 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:01.772080 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a9f93bd4-7e39-4397-b1d2-41121ab3eaa5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:01.772903 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a9f93bd4-7e39-4397-b1d2-41121ab3eaa5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:01.780125 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a9f93bd4-7e39-4397-b1d2-41121ab3eaa5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:01.780570 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a9f93bd4-7e39-4397-b1d2-41121ab3eaa5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:01.781377 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a9f93bd4-7e39-4397-b1d2-41121ab3eaa5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:01.781817 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a9f93bd4-7e39-4397-b1d2-41121ab3eaa5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:01.907136 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a9f93bd4-7e39-4397-b1d2-41121ab3eaa5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:01.914990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a9f93bd4-7e39-4397-b1d2-41121ab3eaa5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:01.916504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a9f93bd4-7e39-4397-b1d2-41121ab3eaa5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:01.917693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a9f93bd4-7e39-4397-b1d2-41121ab3eaa5 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1720 microversion: 2.20 time: 0.150059 May 26 14:06:01.918248 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 538/1114] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:01 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:02.936209 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-221c87ad-d51f-445f-9e1d-afd5eab408fa tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:02.936810 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-221c87ad-d51f-445f-9e1d-afd5eab408fa tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:02.943304 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-221c87ad-d51f-445f-9e1d-afd5eab408fa tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:02.943746 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-221c87ad-d51f-445f-9e1d-afd5eab408fa tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:02.944500 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-221c87ad-d51f-445f-9e1d-afd5eab408fa tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:02.944931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-221c87ad-d51f-445f-9e1d-afd5eab408fa tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:03.072870 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-221c87ad-d51f-445f-9e1d-afd5eab408fa tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:03.075152 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:06:03.083441 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-221c87ad-d51f-445f-9e1d-afd5eab408fa tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:03.084926 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-221c87ad-d51f-445f-9e1d-afd5eab408fa tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:03.086116 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-221c87ad-d51f-445f-9e1d-afd5eab408fa tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1720 microversion: 2.20 time: 0.154321 May 26 14:06:03.086674 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 577/1115] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:02 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:04.104759 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a97b2a96-d630-41fb-b5b3-6b7d7016f04a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:04.105467 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a97b2a96-d630-41fb-b5b3-6b7d7016f04a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:04.112027 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a97b2a96-d630-41fb-b5b3-6b7d7016f04a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:04.112479 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a97b2a96-d630-41fb-b5b3-6b7d7016f04a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:04.113318 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a97b2a96-d630-41fb-b5b3-6b7d7016f04a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:04.113759 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a97b2a96-d630-41fb-b5b3-6b7d7016f04a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:04.399610 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a97b2a96-d630-41fb-b5b3-6b7d7016f04a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:04.407855 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a97b2a96-d630-41fb-b5b3-6b7d7016f04a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:04.409401 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a97b2a96-d630-41fb-b5b3-6b7d7016f04a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:04.410566 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a97b2a96-d630-41fb-b5b3-6b7d7016f04a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1720 microversion: 2.20 time: 0.309726 May 26 14:06:04.411130 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 539/1116] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:04 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1720 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:05.429077 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cbe6a7d6-f8be-4b8b-8c8a-adbdacf07ad1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:05.429663 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-cbe6a7d6-f8be-4b8b-8c8a-adbdacf07ad1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:05.437604 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cbe6a7d6-f8be-4b8b-8c8a-adbdacf07ad1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:05.438052 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cbe6a7d6-f8be-4b8b-8c8a-adbdacf07ad1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:05.438827 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cbe6a7d6-f8be-4b8b-8c8a-adbdacf07ad1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:05.439252 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cbe6a7d6-f8be-4b8b-8c8a-adbdacf07ad1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:05.615708 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cbe6a7d6-f8be-4b8b-8c8a-adbdacf07ad1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:05.624327 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cbe6a7d6-f8be-4b8b-8c8a-adbdacf07ad1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:05.625857 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cbe6a7d6-f8be-4b8b-8c8a-adbdacf07ad1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:05.627017 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-cbe6a7d6-f8be-4b8b-8c8a-adbdacf07ad1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1720 microversion: 2.20 time: 0.202326 May 26 14:06:05.627575 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 578/1117] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:05 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1720 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:06.645409 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-02b6fe44-d9b8-4103-9230-eaaceb9d8abf tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:06.646009 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-02b6fe44-d9b8-4103-9230-eaaceb9d8abf tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:06.648595 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:06:06.654540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02b6fe44-d9b8-4103-9230-eaaceb9d8abf tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:06.654986 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02b6fe44-d9b8-4103-9230-eaaceb9d8abf tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:06.655750 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02b6fe44-d9b8-4103-9230-eaaceb9d8abf tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:06.656206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02b6fe44-d9b8-4103-9230-eaaceb9d8abf tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:06.786360 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-02b6fe44-d9b8-4103-9230-eaaceb9d8abf tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:06.794129 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-02b6fe44-d9b8-4103-9230-eaaceb9d8abf tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:06.796223 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-02b6fe44-d9b8-4103-9230-eaaceb9d8abf tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:06.797398 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-02b6fe44-d9b8-4103-9230-eaaceb9d8abf tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1741 microversion: 2.20 time: 0.155919 May 26 14:06:06.797968 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 540/1118] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:06 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1741 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:07.816112 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-251170dc-54c3-40af-afc5-d53a885834a8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:07.816707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-251170dc-54c3-40af-afc5-d53a885834a8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:07.823297 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-251170dc-54c3-40af-afc5-d53a885834a8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:07.823738 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-251170dc-54c3-40af-afc5-d53a885834a8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:07.824492 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-251170dc-54c3-40af-afc5-d53a885834a8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:07.824919 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-251170dc-54c3-40af-afc5-d53a885834a8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:07.949871 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-251170dc-54c3-40af-afc5-d53a885834a8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:07.963348 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-251170dc-54c3-40af-afc5-d53a885834a8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:07.964857 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-251170dc-54c3-40af-afc5-d53a885834a8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:07.966567 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-251170dc-54c3-40af-afc5-d53a885834a8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1741 microversion: 2.20 time: 0.153867 May 26 14:06:07.967124 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 579/1119] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:07 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1741 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:08.984484 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0ac30255-1cd0-4c61-ab60-5b0c5fdd541a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:08.985098 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0ac30255-1cd0-4c61-ab60-5b0c5fdd541a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:08.991699 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ac30255-1cd0-4c61-ab60-5b0c5fdd541a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:08.992151 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ac30255-1cd0-4c61-ab60-5b0c5fdd541a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:08.992922 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ac30255-1cd0-4c61-ab60-5b0c5fdd541a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:08.993388 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ac30255-1cd0-4c61-ab60-5b0c5fdd541a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:08.995910 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:06:09.129930 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0ac30255-1cd0-4c61-ab60-5b0c5fdd541a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:09.137903 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0ac30255-1cd0-4c61-ab60-5b0c5fdd541a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:09.139713 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0ac30255-1cd0-4c61-ab60-5b0c5fdd541a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:09.140891 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0ac30255-1cd0-4c61-ab60-5b0c5fdd541a tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1741 microversion: 2.20 time: 0.160363 May 26 14:06:09.141510 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 541/1120] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:08 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1741 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:10.159529 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d7aadce4-d514-4c51-a8c2-ce2c4f854dc3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:10.160067 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d7aadce4-d514-4c51-a8c2-ce2c4f854dc3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:10.166601 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d7aadce4-d514-4c51-a8c2-ce2c4f854dc3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:10.167040 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d7aadce4-d514-4c51-a8c2-ce2c4f854dc3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:10.167792 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d7aadce4-d514-4c51-a8c2-ce2c4f854dc3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:10.168224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d7aadce4-d514-4c51-a8c2-ce2c4f854dc3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:10.303531 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d7aadce4-d514-4c51-a8c2-ce2c4f854dc3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:10.311876 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d7aadce4-d514-4c51-a8c2-ce2c4f854dc3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:10.313398 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d7aadce4-d514-4c51-a8c2-ce2c4f854dc3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:10.314572 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d7aadce4-d514-4c51-a8c2-ce2c4f854dc3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1741 microversion: 2.20 time: 0.159026 May 26 14:06:10.315128 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 580/1121] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:10 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1741 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:11.332852 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ea942449-bc48-427b-91be-f2f281d4dff3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:11.333421 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ea942449-bc48-427b-91be-f2f281d4dff3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:11.339861 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ea942449-bc48-427b-91be-f2f281d4dff3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:11.340309 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ea942449-bc48-427b-91be-f2f281d4dff3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:11.341069 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ea942449-bc48-427b-91be-f2f281d4dff3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:11.341528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ea942449-bc48-427b-91be-f2f281d4dff3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:11.472877 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ea942449-bc48-427b-91be-f2f281d4dff3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:11.481072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ea942449-bc48-427b-91be-f2f281d4dff3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:11.483846 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ea942449-bc48-427b-91be-f2f281d4dff3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:11.485017 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ea942449-bc48-427b-91be-f2f281d4dff3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1741 microversion: 2.20 time: 0.156286 May 26 14:06:11.485688 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 542/1122] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:11 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1741 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:11.543676 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-222553ad-de6b-4e42-b1e4-a562cea8be7f req-f60f9c58-f8fe-4352-9813-adc7254a657d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7", "name": "network-vif-plugged", "status": "completed", "tag": "703563f0-f1dc-4261-919d-1995757e7da5"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:06:11.553555 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-222553ad-de6b-4e42-b1e4-a562cea8be7f req-f60f9c58-f8fe-4352-9813-adc7254a657d service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:11.554154 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-222553ad-de6b-4e42-b1e4-a562cea8be7f req-f60f9c58-f8fe-4352-9813-adc7254a657d service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:11.566722 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-222553ad-de6b-4e42-b1e4-a562cea8be7f req-f60f9c58-f8fe-4352-9813-adc7254a657d service nova] Creating event network-vif-plugged:703563f0-f1dc-4261-919d-1995757e7da5 for instance 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 on hv-cinder-84213 May 26 14:06:11.571889 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-222553ad-de6b-4e42-b1e4-a562cea8be7f req-f60f9c58-f8fe-4352-9813-adc7254a657d service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032062 May 26 14:06:11.572754 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 581/1123] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:06:12.503852 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-847ebe5e-cddc-4a95-8838-0090242df456 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:12.504672 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-847ebe5e-cddc-4a95-8838-0090242df456 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:12.511183 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-847ebe5e-cddc-4a95-8838-0090242df456 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:12.511635 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-847ebe5e-cddc-4a95-8838-0090242df456 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:12.512453 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-847ebe5e-cddc-4a95-8838-0090242df456 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:12.513481 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-847ebe5e-cddc-4a95-8838-0090242df456 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:12.655808 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-847ebe5e-cddc-4a95-8838-0090242df456 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:12.663762 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-847ebe5e-cddc-4a95-8838-0090242df456 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:12.665358 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-847ebe5e-cddc-4a95-8838-0090242df456 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:12.666529 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-847ebe5e-cddc-4a95-8838-0090242df456 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1736 microversion: 2.20 time: 0.166915 May 26 14:06:12.667069 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 543/1124] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:12 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:13.686067 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d8494a7f-d086-4676-8960-894846b8fcc9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:13.687515 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d8494a7f-d086-4676-8960-894846b8fcc9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:13.694221 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d8494a7f-d086-4676-8960-894846b8fcc9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:13.694669 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d8494a7f-d086-4676-8960-894846b8fcc9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:13.695646 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d8494a7f-d086-4676-8960-894846b8fcc9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:13.696085 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d8494a7f-d086-4676-8960-894846b8fcc9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:13.857446 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d8494a7f-d086-4676-8960-894846b8fcc9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:13.865714 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d8494a7f-d086-4676-8960-894846b8fcc9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:13.868099 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d8494a7f-d086-4676-8960-894846b8fcc9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:13.869438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d8494a7f-d086-4676-8960-894846b8fcc9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1736 microversion: 2.20 time: 0.188136 May 26 14:06:13.879954 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 582/1125] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:13 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:14.887378 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9993f9bf-2f51-48c9-b77a-635d49c6667d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:14.888687 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9993f9bf-2f51-48c9-b77a-635d49c6667d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:14.895343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9993f9bf-2f51-48c9-b77a-635d49c6667d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:14.896030 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9993f9bf-2f51-48c9-b77a-635d49c6667d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:14.896803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9993f9bf-2f51-48c9-b77a-635d49c6667d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:14.897271 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9993f9bf-2f51-48c9-b77a-635d49c6667d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:15.043336 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9993f9bf-2f51-48c9-b77a-635d49c6667d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:15.052496 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9993f9bf-2f51-48c9-b77a-635d49c6667d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:15.053840 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9993f9bf-2f51-48c9-b77a-635d49c6667d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:15.055183 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9993f9bf-2f51-48c9-b77a-635d49c6667d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1736 microversion: 2.20 time: 0.171703 May 26 14:06:15.065998 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 544/1126] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:14 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:16.073608 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c922444d-bcec-4a64-a23c-3d9104b43237 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:16.074220 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c922444d-bcec-4a64-a23c-3d9104b43237 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:16.081119 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c922444d-bcec-4a64-a23c-3d9104b43237 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:16.081591 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c922444d-bcec-4a64-a23c-3d9104b43237 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:16.082365 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c922444d-bcec-4a64-a23c-3d9104b43237 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:16.082811 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c922444d-bcec-4a64-a23c-3d9104b43237 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:16.259240 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c922444d-bcec-4a64-a23c-3d9104b43237 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:16.269953 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c922444d-bcec-4a64-a23c-3d9104b43237 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:16.271637 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c922444d-bcec-4a64-a23c-3d9104b43237 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:16.273472 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c922444d-bcec-4a64-a23c-3d9104b43237 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1736 microversion: 2.20 time: 0.203722 May 26 14:06:16.274183 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 583/1127] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:16 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1736 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:17.292454 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-af8dad91-1809-4015-afd2-86d94a923559 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:17.293023 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-af8dad91-1809-4015-afd2-86d94a923559 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:17.301279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-af8dad91-1809-4015-afd2-86d94a923559 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:17.301737 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-af8dad91-1809-4015-afd2-86d94a923559 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:17.302522 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-af8dad91-1809-4015-afd2-86d94a923559 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:17.302957 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-af8dad91-1809-4015-afd2-86d94a923559 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:17.443739 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-af8dad91-1809-4015-afd2-86d94a923559 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:17.452162 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-af8dad91-1809-4015-afd2-86d94a923559 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:17.453682 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-af8dad91-1809-4015-afd2-86d94a923559 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:17.454823 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-af8dad91-1809-4015-afd2-86d94a923559 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1736 microversion: 2.20 time: 0.166756 May 26 14:06:17.455456 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 545/1128] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:17 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:18.461659 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:06:18.462221 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Thu May 26 14:06:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 14:06:18.473326 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9bcdaaf8-428b-449c-87be-4958e1be07df tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:18.473924 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9bcdaaf8-428b-449c-87be-4958e1be07df tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:18.480408 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9bcdaaf8-428b-449c-87be-4958e1be07df tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:18.480849 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9bcdaaf8-428b-449c-87be-4958e1be07df tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:18.481637 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9bcdaaf8-428b-449c-87be-4958e1be07df tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:18.482067 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9bcdaaf8-428b-449c-87be-4958e1be07df tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:18.630818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9bcdaaf8-428b-449c-87be-4958e1be07df tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:18.643117 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9bcdaaf8-428b-449c-87be-4958e1be07df tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:18.644841 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9bcdaaf8-428b-449c-87be-4958e1be07df tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:18.646245 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9bcdaaf8-428b-449c-87be-4958e1be07df tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1736 microversion: 2.20 time: 0.176608 May 26 14:06:18.647137 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 584/1129] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:18 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:06:19.665241 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a888b4b3-1a24-46fd-9b2b-2f591d6bf421 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:19.665856 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a888b4b3-1a24-46fd-9b2b-2f591d6bf421 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:19.673128 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a888b4b3-1a24-46fd-9b2b-2f591d6bf421 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:19.673720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a888b4b3-1a24-46fd-9b2b-2f591d6bf421 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:19.674529 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a888b4b3-1a24-46fd-9b2b-2f591d6bf421 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:19.674964 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a888b4b3-1a24-46fd-9b2b-2f591d6bf421 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:19.809999 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a888b4b3-1a24-46fd-9b2b-2f591d6bf421 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:19.818246 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a888b4b3-1a24-46fd-9b2b-2f591d6bf421 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:19.819758 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a888b4b3-1a24-46fd-9b2b-2f591d6bf421 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:19.820921 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a888b4b3-1a24-46fd-9b2b-2f591d6bf421 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1736 microversion: 2.20 time: 0.160473 May 26 14:06:19.821513 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 546/1130] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:19 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:20.840388 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-bc261cf0-487a-4db0-935a-0a065170ed98 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:20.841828 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-bc261cf0-487a-4db0-935a-0a065170ed98 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:20.847300 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bc261cf0-487a-4db0-935a-0a065170ed98 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:20.847815 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bc261cf0-487a-4db0-935a-0a065170ed98 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:20.848819 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bc261cf0-487a-4db0-935a-0a065170ed98 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:20.849286 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bc261cf0-487a-4db0-935a-0a065170ed98 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:20.988924 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bc261cf0-487a-4db0-935a-0a065170ed98 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:20.998578 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bc261cf0-487a-4db0-935a-0a065170ed98 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:21.000531 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bc261cf0-487a-4db0-935a-0a065170ed98 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:21.001837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-bc261cf0-487a-4db0-935a-0a065170ed98 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1736 microversion: 2.20 time: 0.165586 May 26 14:06:21.002822 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 585/1131] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:20 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:22.021795 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b3c5e4e7-8d90-4d4d-a33f-3ea6b717462b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:22.024158 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b3c5e4e7-8d90-4d4d-a33f-3ea6b717462b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:22.033223 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b3c5e4e7-8d90-4d4d-a33f-3ea6b717462b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:22.034066 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b3c5e4e7-8d90-4d4d-a33f-3ea6b717462b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:22.036853 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b3c5e4e7-8d90-4d4d-a33f-3ea6b717462b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:22.037326 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b3c5e4e7-8d90-4d4d-a33f-3ea6b717462b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:22.302398 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b3c5e4e7-8d90-4d4d-a33f-3ea6b717462b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:22.311978 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b3c5e4e7-8d90-4d4d-a33f-3ea6b717462b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:22.313656 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b3c5e4e7-8d90-4d4d-a33f-3ea6b717462b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:22.315532 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b3c5e4e7-8d90-4d4d-a33f-3ea6b717462b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1736 microversion: 2.20 time: 0.297289 May 26 14:06:22.316893 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 547/1132] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:22 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1736 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:22.491820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e17a214f-b4af-4877-886b-6666b7dc8f75 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:22.493103 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e17a214f-b4af-4877-886b-6666b7dc8f75 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:22.498955 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-ceaf5c9e-cd7b-4184-bfab-58358ed9d398 req-c346fc3d-cbdf-4ac2-a734-2df7db733dca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4176fdc7-3ccd-4093-b4c4-841eafb524f7", "tag": "7d604ff9-6337-4905-bd16-e0eb02d19035"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:06:22.513597 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-ceaf5c9e-cd7b-4184-bfab-58358ed9d398 req-c346fc3d-cbdf-4ac2-a734-2df7db733dca service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:22.514054 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-ceaf5c9e-cd7b-4184-bfab-58358ed9d398 req-c346fc3d-cbdf-4ac2-a734-2df7db733dca service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:22.526984 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e17a214f-b4af-4877-886b-6666b7dc8f75 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:22.529483 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e17a214f-b4af-4877-886b-6666b7dc8f75 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:22.531806 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e17a214f-b4af-4877-886b-6666b7dc8f75 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:22.534158 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e17a214f-b4af-4877-886b-6666b7dc8f75 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:22.539111 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-ceaf5c9e-cd7b-4184-bfab-58358ed9d398 req-c346fc3d-cbdf-4ac2-a734-2df7db733dca service nova] Creating event network-changed:7d604ff9-6337-4905-bd16-e0eb02d19035 for instance 4176fdc7-3ccd-4093-b4c4-841eafb524f7 on hv-cinder-84213 May 26 14:06:22.547541 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-ceaf5c9e-cd7b-4184-bfab-58358ed9d398 req-c346fc3d-cbdf-4ac2-a734-2df7db733dca service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053149 May 26 14:06:22.548853 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 548/1133] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:06:22.572147 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e17a214f-b4af-4877-886b-6666b7dc8f75 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 14:06:22.696069 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e17a214f-b4af-4877-886b-6666b7dc8f75 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "DELETE /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 204 len: 0 microversion: 2.1 time: 0.207397 May 26 14:06:22.697795 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 586/1134] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 14:06:22 2022] DELETE /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 14:06:22.708313 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0fab70ed-5c24-4af8-b25d-46d3ac2a7478 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:22.709105 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0fab70ed-5c24-4af8-b25d-46d3ac2a7478 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:22.718962 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0fab70ed-5c24-4af8-b25d-46d3ac2a7478 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:22.719431 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0fab70ed-5c24-4af8-b25d-46d3ac2a7478 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:22.720211 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0fab70ed-5c24-4af8-b25d-46d3ac2a7478 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:22.720656 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0fab70ed-5c24-4af8-b25d-46d3ac2a7478 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:22.896922 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0fab70ed-5c24-4af8-b25d-46d3ac2a7478 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:22.907079 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0fab70ed-5c24-4af8-b25d-46d3ac2a7478 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1568 microversion: 2.1 time: 0.204152 May 26 14:06:22.908328 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 549/1135] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:06:22 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:06:23.336181 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e7280d42-063f-4edd-b222-312c4c4fbbaa tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:23.337046 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e7280d42-063f-4edd-b222-312c4c4fbbaa tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:23.343691 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e7280d42-063f-4edd-b222-312c4c4fbbaa tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:23.344424 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e7280d42-063f-4edd-b222-312c4c4fbbaa tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:23.344928 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e7280d42-063f-4edd-b222-312c4c4fbbaa tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:23.345473 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e7280d42-063f-4edd-b222-312c4c4fbbaa tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:23.495986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e7280d42-063f-4edd-b222-312c4c4fbbaa tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:23.505874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e7280d42-063f-4edd-b222-312c4c4fbbaa tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:23.507760 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e7280d42-063f-4edd-b222-312c4c4fbbaa tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:23.509063 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e7280d42-063f-4edd-b222-312c4c4fbbaa tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1736 microversion: 2.20 time: 0.177858 May 26 14:06:23.509833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 587/1136] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:23 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:23.935139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1ce3783e-02f2-4d26-b16a-e86bca6956ff tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:23.936358 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1ce3783e-02f2-4d26-b16a-e86bca6956ff tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:23.943792 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1ce3783e-02f2-4d26-b16a-e86bca6956ff tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:23.944461 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1ce3783e-02f2-4d26-b16a-e86bca6956ff tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:23.945324 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1ce3783e-02f2-4d26-b16a-e86bca6956ff tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:23.945773 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1ce3783e-02f2-4d26-b16a-e86bca6956ff tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:24.119711 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1ce3783e-02f2-4d26-b16a-e86bca6956ff tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:24.130562 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1ce3783e-02f2-4d26-b16a-e86bca6956ff tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1568 microversion: 2.1 time: 0.209644 May 26 14:06:24.132488 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 550/1137] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:06:23 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:06:24.528489 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7f4da4cd-d20a-414e-9eb6-b892ba863d7d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:24.529097 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7f4da4cd-d20a-414e-9eb6-b892ba863d7d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:24.535876 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f4da4cd-d20a-414e-9eb6-b892ba863d7d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:24.536539 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f4da4cd-d20a-414e-9eb6-b892ba863d7d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:24.537427 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f4da4cd-d20a-414e-9eb6-b892ba863d7d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:24.537868 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f4da4cd-d20a-414e-9eb6-b892ba863d7d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:24.678274 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7f4da4cd-d20a-414e-9eb6-b892ba863d7d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:24.686523 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7f4da4cd-d20a-414e-9eb6-b892ba863d7d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:24.688018 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7f4da4cd-d20a-414e-9eb6-b892ba863d7d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:24.689193 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7f4da4cd-d20a-414e-9eb6-b892ba863d7d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1736 microversion: 2.20 time: 0.165143 May 26 14:06:24.689749 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 588/1138] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:24 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:25.148402 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b70e5249-e6df-4f46-b9e7-6965e9b42e6f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:25.149268 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b70e5249-e6df-4f46-b9e7-6965e9b42e6f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:25.156807 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b70e5249-e6df-4f46-b9e7-6965e9b42e6f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:25.157289 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b70e5249-e6df-4f46-b9e7-6965e9b42e6f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:25.158065 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b70e5249-e6df-4f46-b9e7-6965e9b42e6f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:25.158507 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b70e5249-e6df-4f46-b9e7-6965e9b42e6f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:25.292607 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b70e5249-e6df-4f46-b9e7-6965e9b42e6f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:25.300314 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b70e5249-e6df-4f46-b9e7-6965e9b42e6f tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1450 microversion: 2.1 time: 0.156272 May 26 14:06:25.300889 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 551/1139] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:06:25 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:06:25.623732 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-92e6d956-6c0c-47c9-b5d3-ddafc13b06b6 req-24ffb813-5b51-41ce-8dad-5dc460a41db1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4176fdc7-3ccd-4093-b4c4-841eafb524f7", "name": "network-vif-deleted", "tag": "7d604ff9-6337-4905-bd16-e0eb02d19035"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:06:25.633477 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-92e6d956-6c0c-47c9-b5d3-ddafc13b06b6 req-24ffb813-5b51-41ce-8dad-5dc460a41db1 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:25.633925 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-92e6d956-6c0c-47c9-b5d3-ddafc13b06b6 req-24ffb813-5b51-41ce-8dad-5dc460a41db1 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:25.648779 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-92e6d956-6c0c-47c9-b5d3-ddafc13b06b6 req-24ffb813-5b51-41ce-8dad-5dc460a41db1 service nova] Creating event network-vif-deleted:7d604ff9-6337-4905-bd16-e0eb02d19035 for instance 4176fdc7-3ccd-4093-b4c4-841eafb524f7 on hv-cinder-84213 May 26 14:06:25.654450 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-92e6d956-6c0c-47c9-b5d3-ddafc13b06b6 req-24ffb813-5b51-41ce-8dad-5dc460a41db1 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035054 May 26 14:06:25.655297 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 589/1140] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:06:25.709412 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ad8ffcaa-5502-4040-b0b2-ec13cb7dc685 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:25.710916 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ad8ffcaa-5502-4040-b0b2-ec13cb7dc685 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:25.722598 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ad8ffcaa-5502-4040-b0b2-ec13cb7dc685 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:25.724254 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ad8ffcaa-5502-4040-b0b2-ec13cb7dc685 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:25.725128 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ad8ffcaa-5502-4040-b0b2-ec13cb7dc685 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:25.727557 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ad8ffcaa-5502-4040-b0b2-ec13cb7dc685 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:25.876372 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ad8ffcaa-5502-4040-b0b2-ec13cb7dc685 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:25.884827 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ad8ffcaa-5502-4040-b0b2-ec13cb7dc685 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:25.886482 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ad8ffcaa-5502-4040-b0b2-ec13cb7dc685 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:25.887937 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ad8ffcaa-5502-4040-b0b2-ec13cb7dc685 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1718 microversion: 2.20 time: 0.184115 May 26 14:06:25.888502 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 552/1141] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:25 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1718 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:26.317375 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2f08f5a9-3799-4b1c-b630-44a1ba16b70e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:26.318066 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2f08f5a9-3799-4b1c-b630-44a1ba16b70e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:26.320004 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:06:26.326042 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2f08f5a9-3799-4b1c-b630-44a1ba16b70e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:26.326493 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2f08f5a9-3799-4b1c-b630-44a1ba16b70e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:26.327292 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2f08f5a9-3799-4b1c-b630-44a1ba16b70e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:26.327728 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2f08f5a9-3799-4b1c-b630-44a1ba16b70e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:26.362267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2f08f5a9-3799-4b1c-b630-44a1ba16b70e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:26.362711 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2f08f5a9-3799-4b1c-b630-44a1ba16b70e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:26.363159 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-2f08f5a9-3799-4b1c-b630-44a1ba16b70e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lazy-loading 'fault' on Instance uuid 4176fdc7-3ccd-4093-b4c4-841eafb524f7 {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:06:26.404433 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2f08f5a9-3799-4b1c-b630-44a1ba16b70e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:26.412576 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2f08f5a9-3799-4b1c-b630-44a1ba16b70e tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1224 microversion: 2.1 time: 0.099364 May 26 14:06:26.413145 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 590/1142] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:06:26 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:06:26.907058 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f1b3951e-83c3-42f1-af86-fde1e34c0fa7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:26.907589 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f1b3951e-83c3-42f1-af86-fde1e34c0fa7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:26.914089 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f1b3951e-83c3-42f1-af86-fde1e34c0fa7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:26.914538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f1b3951e-83c3-42f1-af86-fde1e34c0fa7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:26.915309 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f1b3951e-83c3-42f1-af86-fde1e34c0fa7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:26.915746 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f1b3951e-83c3-42f1-af86-fde1e34c0fa7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:27.041334 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f1b3951e-83c3-42f1-af86-fde1e34c0fa7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:27.050213 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f1b3951e-83c3-42f1-af86-fde1e34c0fa7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:27.051759 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f1b3951e-83c3-42f1-af86-fde1e34c0fa7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:27.052916 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f1b3951e-83c3-42f1-af86-fde1e34c0fa7 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1718 microversion: 2.20 time: 0.150498 May 26 14:06:27.053518 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 553/1143] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:26 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:27.430654 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cd13c849-af2b-46bf-ab02-8b35cef8f74a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:27.431268 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-cd13c849-af2b-46bf-ab02-8b35cef8f74a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:27.437482 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cd13c849-af2b-46bf-ab02-8b35cef8f74a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:27.437927 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cd13c849-af2b-46bf-ab02-8b35cef8f74a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:27.438688 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cd13c849-af2b-46bf-ab02-8b35cef8f74a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:27.439173 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cd13c849-af2b-46bf-ab02-8b35cef8f74a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:27.471763 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cd13c849-af2b-46bf-ab02-8b35cef8f74a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:27.472128 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cd13c849-af2b-46bf-ab02-8b35cef8f74a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:27.472574 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-cd13c849-af2b-46bf-ab02-8b35cef8f74a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lazy-loading 'fault' on Instance uuid 4176fdc7-3ccd-4093-b4c4-841eafb524f7 {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:06:27.515628 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cd13c849-af2b-46bf-ab02-8b35cef8f74a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecacca157e3a43b79659f78e4beb0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d13c9a0ad1146158525c3398ff4de2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:27.523069 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-cd13c849-af2b-46bf-ab02-8b35cef8f74a tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 200 len: 1224 microversion: 2.1 time: 0.096323 May 26 14:06:27.523625 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 591/1144] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:06:27 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:06:28.070886 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-85a6863f-d522-4925-9eaa-937621609f2b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:28.071492 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-85a6863f-d522-4925-9eaa-937621609f2b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:28.078766 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-85a6863f-d522-4925-9eaa-937621609f2b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:28.079218 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-85a6863f-d522-4925-9eaa-937621609f2b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:28.080008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-85a6863f-d522-4925-9eaa-937621609f2b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:28.080440 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-85a6863f-d522-4925-9eaa-937621609f2b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:28.215905 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-85a6863f-d522-4925-9eaa-937621609f2b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:28.224296 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-85a6863f-d522-4925-9eaa-937621609f2b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:28.225813 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-85a6863f-d522-4925-9eaa-937621609f2b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:28.226959 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-85a6863f-d522-4925-9eaa-937621609f2b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1718 microversion: 2.20 time: 0.160054 May 26 14:06:28.227507 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 554/1145] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:28 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:28.539780 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d261328f-03eb-43c2-93ec-32f0d49170b6 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:28.540325 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d261328f-03eb-43c2-93ec-32f0d49170b6 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] [instance: 4176fdc7-3ccd-4093-b4c4-841eafb524f7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:28.546832 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d261328f-03eb-43c2-93ec-32f0d49170b6 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:28.547278 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d261328f-03eb-43c2-93ec-32f0d49170b6 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:28.548032 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d261328f-03eb-43c2-93ec-32f0d49170b6 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:28.548463 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d261328f-03eb-43c2-93ec-32f0d49170b6 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:28.562120 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-d261328f-03eb-43c2-93ec-32f0d49170b6 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] HTTP exception thrown: Instance 4176fdc7-3ccd-4093-b4c4-841eafb524f7 could not be found. May 26 14:06:28.563820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d261328f-03eb-43c2-93ec-32f0d49170b6 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Request method failure captured: May 26 14:06:28.563820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 HTTP/1.1 May 26 14:06:28.563820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 14:06:28.563820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 14:06:28.563820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 14:06:28.563820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 14:06:28.563820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 14:06:28.563820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 14:06:28.563820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 14:06:28.563820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 14:06:28.563820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4fB5l5c6y9IX6lpVyurB3h_y8Ospriu3RieektK7igKHuBBsHW_oGv65eD1b3Cu3HdhCqTHnewhY0OGQYO_68a0PpGjqnEZ8LdHzg0rnXtosyBCvlQFXB6Pt2j3O62qaWQ5bV7AU1Kv3bQ0kWl4afDpqxUI3Z2MOaWKQkk2P3YdA4c May 26 14:06:28.563820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 14:06:28.563820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 14:06:28.563820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 14:06:28.563820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 14:06:28.563820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 14:06:28.563820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 14:06:28.563820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: 4d13c9a0ad1146158525c3398ff4de2a May 26 14:06:28.563820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-TestShelveInstance-1711771670 May 26 14:06:28.563820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 14:06:28.563820 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 14:06:28.565549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/4d13c9a0ad1146158525c3398ff4de2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/4d13c9a0ad1146158525c3398ff4de2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/4d13c9a0ad1146158525c3398ff4de2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_4d13c9a0ad1146158525c3398ff4de2a", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:06:28.565549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-TestShelveInstance-1711771670 May 26 14:06:28.565549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 4d13c9a0ad1146158525c3398ff4de2a May 26 14:06:28.565549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-TestShelveInstance-1711771670 May 26 14:06:28.565549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-TestShelveInstance-1711771670-project May 26 14:06:28.565549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 14:06:28.565549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 14:06:28.565549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: ecacca157e3a43b79659f78e4beb0c5e May 26 14:06:28.565549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-TestShelveInstance-1711771670-project May 26 14:06:28.565549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 14:06:28.565549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Instance 4176fdc7-3ccd-4093-b4c4-841eafb524f7 could not be found. May 26 14:06:28.565549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': '4176fdc7-3ccd-4093-b4c4-841eafb524f7'} May 26 14:06:28.566437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:06:28.566437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:06:28.566437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:06:28.566437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:06:28.566437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:06:28.566437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:06:28.566437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:06:28.566437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:06:28.566437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:06:28.566437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:06:28.566437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4176fdc7-3ccd-4093-b4c4-841eafb524f7 could not be found. May 26 14:06:28.566437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:06:28.566437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:06:28.566437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:06:28.566437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:06:28.566437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:06:28.566437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:06:28.566437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:06:28.566437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:06:28.566437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:06:28.567755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:06:28.567755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:06:28.567755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:06:28.567755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:06:28.567755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:06:28.567755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:06:28.567755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:06:28.567755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4176fdc7-3ccd-4093-b4c4-841eafb524f7 could not be found. May 26 14:06:28.567755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:06:28.567755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:06:28.567755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:06:28.567755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:06:28.567755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:06:28.567755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:06:28.567755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:06:28.567755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:06:28.567755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4176fdc7-3ccd-4093-b4c4-841eafb524f7 could not be found. May 26 14:06:28.567755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:06:28.569024 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d261328f-03eb-43c2-93ec-32f0d49170b6 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Returning 404 to user: Instance 4176fdc7-3ccd-4093-b4c4-841eafb524f7 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:06:28.569024 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d261328f-03eb-43c2-93ec-32f0d49170b6 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7" status: 404 len: 111 microversion: 2.1 time: 0.029445 May 26 14:06:28.569024 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 592/1146] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:06:28 2022] GET /compute/v2.1/servers/4176fdc7-3ccd-4093-b4c4-841eafb524f7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:06:28.732454 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e9591136-e940-4024-856c-26c0b6a50d13 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] Calling method '.version_select at 0x7f25a4a39af0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:28.753341 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e9591136-e940-4024-856c-26c0b6a50d13 tempest-TestShelveInstance-1711771670 tempest-TestShelveInstance-1711771670-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1017305677" status: 202 len: 0 microversion: 2.1 time: 0.028517 May 26 14:06:28.754210 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 555/1147] 10.222.0.91 () {58 vars in 1253 bytes} [Thu May 26 14:06:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1017305677 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:06:29.245352 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-02e1cb47-842b-4da7-b11e-bbdf5f82e66d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:29.245965 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-02e1cb47-842b-4da7-b11e-bbdf5f82e66d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:29.251999 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-02e1cb47-842b-4da7-b11e-bbdf5f82e66d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:29.252449 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-02e1cb47-842b-4da7-b11e-bbdf5f82e66d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:29.253242 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-02e1cb47-842b-4da7-b11e-bbdf5f82e66d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:29.253679 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-02e1cb47-842b-4da7-b11e-bbdf5f82e66d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:29.457878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-02e1cb47-842b-4da7-b11e-bbdf5f82e66d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:29.467545 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-02e1cb47-842b-4da7-b11e-bbdf5f82e66d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:29.468419 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-02e1cb47-842b-4da7-b11e-bbdf5f82e66d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:29.469631 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-02e1cb47-842b-4da7-b11e-bbdf5f82e66d tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1661 microversion: 2.20 time: 0.228312 May 26 14:06:29.470425 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 593/1148] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:29 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1661 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:29.487607 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5852f3d1-1f58-4df2-97df-e938960edb0e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2227f9fb-81e8-4dfc-8321-3556872bcfe9"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:06:29.488665 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5852f3d1-1f58-4df2-97df-e938960edb0e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:29.495248 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5852f3d1-1f58-4df2-97df-e938960edb0e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:29.495699 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5852f3d1-1f58-4df2-97df-e938960edb0e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:29.496475 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5852f3d1-1f58-4df2-97df-e938960edb0e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:29.496907 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5852f3d1-1f58-4df2-97df-e938960edb0e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:29.634150 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-9e905d2b-318a-4ffc-ab90-8e99ba55f3d9 req-9b10324e-aff7-4d16-8ab9-cea7d5cb8335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7", "name": "network-vif-unplugged", "status": "completed", "tag": "703563f0-f1dc-4261-919d-1995757e7da5"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:06:29.647504 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-9e905d2b-318a-4ffc-ab90-8e99ba55f3d9 req-9b10324e-aff7-4d16-8ab9-cea7d5cb8335 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:29.648244 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-9e905d2b-318a-4ffc-ab90-8e99ba55f3d9 req-9b10324e-aff7-4d16-8ab9-cea7d5cb8335 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:29.660707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:06:29.665603 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.compute.server_external_events [req-9e905d2b-318a-4ffc-ab90-8e99ba55f3d9 req-9b10324e-aff7-4d16-8ab9-cea7d5cb8335 service nova] Unable to find a host for instance 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7. Dropping event network-vif-unplugged {{(pid=117788) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 14:06:29.667421 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-9e905d2b-318a-4ffc-ab90-8e99ba55f3d9 req-9b10324e-aff7-4d16-8ab9-cea7d5cb8335 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037685 May 26 14:06:29.668623 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 594/1149] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 26 14:06:29.808096 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:06:29.817756 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5852f3d1-1f58-4df2-97df-e938960edb0e tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "POST /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.334605 May 26 14:06:29.818366 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 556/1150] 10.222.0.91 () {62 vars in 1363 bytes} [Thu May 26 14:06:29 2022] POST /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7/os-volume_attachments => generated 188 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:06:29.988331 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6d338174-6e3f-4b6b-9e42-8de2e4c03a3f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:29.989050 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6d338174-6e3f-4b6b-9e42-8de2e4c03a3f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:29.997501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6d338174-6e3f-4b6b-9e42-8de2e4c03a3f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:29.997979 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6d338174-6e3f-4b6b-9e42-8de2e4c03a3f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:29.998775 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6d338174-6e3f-4b6b-9e42-8de2e4c03a3f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:29.999227 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6d338174-6e3f-4b6b-9e42-8de2e4c03a3f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:30.270106 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6d338174-6e3f-4b6b-9e42-8de2e4c03a3f tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "DELETE /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7/os-volume_attachments/2227f9fb-81e8-4dfc-8321-3556872bcfe9" status: 202 len: 0 microversion: 2.20 time: 0.287959 May 26 14:06:30.270718 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 595/1151] 10.222.0.91 () {60 vars in 1456 bytes} [Thu May 26 14:06:29 2022] DELETE /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7/os-volume_attachments/2227f9fb-81e8-4dfc-8321-3556872bcfe9 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 14:06:30.330581 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c87f1c65-4848-4847-b6a9-13b798f46c1b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:06:30.331156 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c87f1c65-4848-4847-b6a9-13b798f46c1b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:30.338634 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c87f1c65-4848-4847-b6a9-13b798f46c1b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:30.339088 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c87f1c65-4848-4847-b6a9-13b798f46c1b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:30.339873 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c87f1c65-4848-4847-b6a9-13b798f46c1b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:30.340871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c87f1c65-4848-4847-b6a9-13b798f46c1b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:30.424854 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c87f1c65-4848-4847-b6a9-13b798f46c1b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "POST /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7/action" status: 202 len: 0 microversion: 2.20 time: 0.098127 May 26 14:06:30.426068 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 557/1152] 10.222.0.91 () {62 vars in 1318 bytes} [Thu May 26 14:06:30 2022] POST /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 14:06:30.434254 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7f5facdb-9683-42e1-ab96-26b583bf20ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:30.435316 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7f5facdb-9683-42e1-ab96-26b583bf20ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:30.442487 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f5facdb-9683-42e1-ab96-26b583bf20ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:30.442937 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f5facdb-9683-42e1-ab96-26b583bf20ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:30.443778 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f5facdb-9683-42e1-ab96-26b583bf20ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:30.444231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f5facdb-9683-42e1-ab96-26b583bf20ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:30.724570 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7f5facdb-9683-42e1-ab96-26b583bf20ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:30.738862 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7f5facdb-9683-42e1-ab96-26b583bf20ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:30.741593 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7f5facdb-9683-42e1-ab96-26b583bf20ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:30.743021 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7f5facdb-9683-42e1-ab96-26b583bf20ab tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1669 microversion: 2.20 time: 0.312724 May 26 14:06:30.744092 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 596/1153] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:30 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1669 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:06:31.766599 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c6672c74-6bb6-4b8b-a3d5-fc573d2fd584 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:31.767265 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c6672c74-6bb6-4b8b-a3d5-fc573d2fd584 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:31.773681 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c6672c74-6bb6-4b8b-a3d5-fc573d2fd584 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:31.774135 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c6672c74-6bb6-4b8b-a3d5-fc573d2fd584 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:31.774942 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c6672c74-6bb6-4b8b-a3d5-fc573d2fd584 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:31.775355 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c6672c74-6bb6-4b8b-a3d5-fc573d2fd584 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:31.958550 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c6672c74-6bb6-4b8b-a3d5-fc573d2fd584 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:31.967878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c6672c74-6bb6-4b8b-a3d5-fc573d2fd584 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:31.969475 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c6672c74-6bb6-4b8b-a3d5-fc573d2fd584 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:31.970654 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c6672c74-6bb6-4b8b-a3d5-fc573d2fd584 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1727 microversion: 2.20 time: 0.210460 May 26 14:06:31.971222 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 558/1154] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:31 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1727 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:32.990252 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-41dd2007-27e1-46d7-8c0c-49e1a1b9e71c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:32.991119 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-41dd2007-27e1-46d7-8c0c-49e1a1b9e71c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:32.998060 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-41dd2007-27e1-46d7-8c0c-49e1a1b9e71c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:32.998422 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-41dd2007-27e1-46d7-8c0c-49e1a1b9e71c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:32.999198 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-41dd2007-27e1-46d7-8c0c-49e1a1b9e71c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:32.999636 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-41dd2007-27e1-46d7-8c0c-49e1a1b9e71c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:33.241993 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-41dd2007-27e1-46d7-8c0c-49e1a1b9e71c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:33.251182 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-41dd2007-27e1-46d7-8c0c-49e1a1b9e71c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:33.252659 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-41dd2007-27e1-46d7-8c0c-49e1a1b9e71c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:33.253854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-41dd2007-27e1-46d7-8c0c-49e1a1b9e71c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1727 microversion: 2.20 time: 0.267702 May 26 14:06:33.254465 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 597/1155] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:32 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1727 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:34.275856 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9ca11a47-44c1-4a70-b9d9-fc0481f8d674 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:34.278193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9ca11a47-44c1-4a70-b9d9-fc0481f8d674 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:34.287352 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9ca11a47-44c1-4a70-b9d9-fc0481f8d674 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:34.287808 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9ca11a47-44c1-4a70-b9d9-fc0481f8d674 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:34.288618 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9ca11a47-44c1-4a70-b9d9-fc0481f8d674 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:34.289078 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9ca11a47-44c1-4a70-b9d9-fc0481f8d674 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:34.482209 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9ca11a47-44c1-4a70-b9d9-fc0481f8d674 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:34.490462 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9ca11a47-44c1-4a70-b9d9-fc0481f8d674 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:34.492092 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9ca11a47-44c1-4a70-b9d9-fc0481f8d674 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:34.493285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9ca11a47-44c1-4a70-b9d9-fc0481f8d674 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1727 microversion: 2.20 time: 0.224996 May 26 14:06:34.493857 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 559/1156] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:34 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1727 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:35.513228 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b212cd3e-1191-4450-9082-dc1ea1c6910c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:35.514714 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b212cd3e-1191-4450-9082-dc1ea1c6910c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:35.522097 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b212cd3e-1191-4450-9082-dc1ea1c6910c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:35.522929 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b212cd3e-1191-4450-9082-dc1ea1c6910c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:35.523942 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b212cd3e-1191-4450-9082-dc1ea1c6910c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:35.524620 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b212cd3e-1191-4450-9082-dc1ea1c6910c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:35.843590 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b212cd3e-1191-4450-9082-dc1ea1c6910c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:35.853439 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b212cd3e-1191-4450-9082-dc1ea1c6910c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:35.855219 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b212cd3e-1191-4450-9082-dc1ea1c6910c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:35.857075 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b212cd3e-1191-4450-9082-dc1ea1c6910c tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1727 microversion: 2.20 time: 0.348307 May 26 14:06:35.858834 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 598/1157] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:35 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1727 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:36.877463 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-df8b1643-e545-4f86-9ba5-f902400bae19 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:36.883043 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-df8b1643-e545-4f86-9ba5-f902400bae19 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:36.885797 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:06:36.895118 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-df8b1643-e545-4f86-9ba5-f902400bae19 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:36.895578 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-df8b1643-e545-4f86-9ba5-f902400bae19 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:36.896370 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-df8b1643-e545-4f86-9ba5-f902400bae19 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:36.896812 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-df8b1643-e545-4f86-9ba5-f902400bae19 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:37.065038 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-df8b1643-e545-4f86-9ba5-f902400bae19 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:37.079289 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-df8b1643-e545-4f86-9ba5-f902400bae19 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:37.082691 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-df8b1643-e545-4f86-9ba5-f902400bae19 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:37.086895 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-df8b1643-e545-4f86-9ba5-f902400bae19 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1727 microversion: 2.20 time: 0.213376 May 26 14:06:37.098215 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 560/1158] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:36 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1727 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:38.112861 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c76791f2-74d6-434a-bae8-ade79ff4af01 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:38.113619 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c76791f2-74d6-434a-bae8-ade79ff4af01 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:38.121712 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c76791f2-74d6-434a-bae8-ade79ff4af01 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:38.122267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c76791f2-74d6-434a-bae8-ade79ff4af01 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:38.123149 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c76791f2-74d6-434a-bae8-ade79ff4af01 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:38.123715 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c76791f2-74d6-434a-bae8-ade79ff4af01 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:38.304806 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c76791f2-74d6-434a-bae8-ade79ff4af01 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:38.315411 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c76791f2-74d6-434a-bae8-ade79ff4af01 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:38.318222 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c76791f2-74d6-434a-bae8-ade79ff4af01 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:38.320154 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c76791f2-74d6-434a-bae8-ade79ff4af01 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1727 microversion: 2.20 time: 0.217247 May 26 14:06:38.328624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 599/1159] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:38 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1727 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:39.346094 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-aae7cf18-a16e-4ff4-ba8d-1964d5279413 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:39.346685 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-aae7cf18-a16e-4ff4-ba8d-1964d5279413 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:39.352804 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aae7cf18-a16e-4ff4-ba8d-1964d5279413 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:39.353281 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aae7cf18-a16e-4ff4-ba8d-1964d5279413 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:39.354066 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aae7cf18-a16e-4ff4-ba8d-1964d5279413 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:39.354496 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aae7cf18-a16e-4ff4-ba8d-1964d5279413 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:39.505041 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-aae7cf18-a16e-4ff4-ba8d-1964d5279413 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:39.514222 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-aae7cf18-a16e-4ff4-ba8d-1964d5279413 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:39.515886 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-aae7cf18-a16e-4ff4-ba8d-1964d5279413 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:39.517383 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-aae7cf18-a16e-4ff4-ba8d-1964d5279413 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1727 microversion: 2.20 time: 0.179592 May 26 14:06:39.528452 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 561/1160] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:39 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:06:40.536544 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fdea4a61-d6e2-42db-a004-fb4c65988f74 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:40.537118 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fdea4a61-d6e2-42db-a004-fb4c65988f74 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:40.543963 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fdea4a61-d6e2-42db-a004-fb4c65988f74 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:40.544417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fdea4a61-d6e2-42db-a004-fb4c65988f74 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:40.545226 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fdea4a61-d6e2-42db-a004-fb4c65988f74 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:40.545669 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fdea4a61-d6e2-42db-a004-fb4c65988f74 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:40.708088 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fdea4a61-d6e2-42db-a004-fb4c65988f74 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:40.716627 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fdea4a61-d6e2-42db-a004-fb4c65988f74 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:40.718197 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fdea4a61-d6e2-42db-a004-fb4c65988f74 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:40.719402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fdea4a61-d6e2-42db-a004-fb4c65988f74 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1727 microversion: 2.20 time: 0.187443 May 26 14:06:40.720201 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 600/1161] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:40 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1727 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:41.737753 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-980cc085-c697-4c6c-a1ec-482a4dda9891 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:41.739042 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-980cc085-c697-4c6c-a1ec-482a4dda9891 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:41.746614 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-980cc085-c697-4c6c-a1ec-482a4dda9891 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:41.747160 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-980cc085-c697-4c6c-a1ec-482a4dda9891 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:41.748052 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-980cc085-c697-4c6c-a1ec-482a4dda9891 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:41.748749 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-980cc085-c697-4c6c-a1ec-482a4dda9891 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:41.892368 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-980cc085-c697-4c6c-a1ec-482a4dda9891 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:41.901001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-980cc085-c697-4c6c-a1ec-482a4dda9891 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:41.902523 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-980cc085-c697-4c6c-a1ec-482a4dda9891 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:41.903720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-980cc085-c697-4c6c-a1ec-482a4dda9891 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1727 microversion: 2.20 time: 0.169883 May 26 14:06:41.904266 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 562/1162] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:41 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:06:42.921855 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-80489928-73e3-4287-bf92-6660df4aae05 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:42.922570 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-80489928-73e3-4287-bf92-6660df4aae05 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:42.929179 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-80489928-73e3-4287-bf92-6660df4aae05 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:42.929651 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-80489928-73e3-4287-bf92-6660df4aae05 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:42.930436 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-80489928-73e3-4287-bf92-6660df4aae05 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:42.930878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-80489928-73e3-4287-bf92-6660df4aae05 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:43.067001 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-80489928-73e3-4287-bf92-6660df4aae05 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:43.077392 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-80489928-73e3-4287-bf92-6660df4aae05 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:43.079326 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-80489928-73e3-4287-bf92-6660df4aae05 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:43.080915 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-80489928-73e3-4287-bf92-6660df4aae05 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1727 microversion: 2.20 time: 0.163043 May 26 14:06:43.081586 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 601/1163] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:42 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:44.101927 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7576b4c9-15f2-496f-9cd2-d8d9bba180c1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:44.102570 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7576b4c9-15f2-496f-9cd2-d8d9bba180c1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:44.109583 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7576b4c9-15f2-496f-9cd2-d8d9bba180c1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:44.110043 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7576b4c9-15f2-496f-9cd2-d8d9bba180c1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:44.110837 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7576b4c9-15f2-496f-9cd2-d8d9bba180c1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:44.111304 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7576b4c9-15f2-496f-9cd2-d8d9bba180c1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:44.264676 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7576b4c9-15f2-496f-9cd2-d8d9bba180c1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:44.272519 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7576b4c9-15f2-496f-9cd2-d8d9bba180c1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:44.274035 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7576b4c9-15f2-496f-9cd2-d8d9bba180c1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:44.275173 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7576b4c9-15f2-496f-9cd2-d8d9bba180c1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1727 microversion: 2.20 time: 0.177870 May 26 14:06:44.275730 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 563/1164] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:44 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:45.294353 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-34e9f462-5d4c-485e-bdc5-108bf57218a3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:45.294941 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-34e9f462-5d4c-485e-bdc5-108bf57218a3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:45.301570 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-34e9f462-5d4c-485e-bdc5-108bf57218a3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:45.301944 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-34e9f462-5d4c-485e-bdc5-108bf57218a3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:45.302707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-34e9f462-5d4c-485e-bdc5-108bf57218a3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:45.303173 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-34e9f462-5d4c-485e-bdc5-108bf57218a3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:45.437338 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-34e9f462-5d4c-485e-bdc5-108bf57218a3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:45.445500 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-34e9f462-5d4c-485e-bdc5-108bf57218a3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:45.447003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-34e9f462-5d4c-485e-bdc5-108bf57218a3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:45.448160 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-34e9f462-5d4c-485e-bdc5-108bf57218a3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1727 microversion: 2.20 time: 0.158226 May 26 14:06:45.448724 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 602/1165] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:45 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:46.467073 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d527dfad-1170-4217-b8ed-895d04ab28c8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:46.467649 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d527dfad-1170-4217-b8ed-895d04ab28c8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:46.474082 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d527dfad-1170-4217-b8ed-895d04ab28c8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:46.474530 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d527dfad-1170-4217-b8ed-895d04ab28c8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:46.475294 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d527dfad-1170-4217-b8ed-895d04ab28c8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:46.475730 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d527dfad-1170-4217-b8ed-895d04ab28c8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:46.622237 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d527dfad-1170-4217-b8ed-895d04ab28c8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:46.630594 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d527dfad-1170-4217-b8ed-895d04ab28c8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:46.632083 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d527dfad-1170-4217-b8ed-895d04ab28c8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:46.633334 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d527dfad-1170-4217-b8ed-895d04ab28c8 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1727 microversion: 2.20 time: 0.170920 May 26 14:06:46.633896 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 564/1166] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:46 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:47.655001 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8545d5cf-1a52-4e1b-8ac5-b8db021b8178 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:47.656022 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8545d5cf-1a52-4e1b-8ac5-b8db021b8178 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:47.665031 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8545d5cf-1a52-4e1b-8ac5-b8db021b8178 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:47.665516 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8545d5cf-1a52-4e1b-8ac5-b8db021b8178 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:47.666395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8545d5cf-1a52-4e1b-8ac5-b8db021b8178 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:47.666933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8545d5cf-1a52-4e1b-8ac5-b8db021b8178 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:47.806928 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8545d5cf-1a52-4e1b-8ac5-b8db021b8178 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:47.815442 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8545d5cf-1a52-4e1b-8ac5-b8db021b8178 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:47.816952 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8545d5cf-1a52-4e1b-8ac5-b8db021b8178 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:47.818135 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8545d5cf-1a52-4e1b-8ac5-b8db021b8178 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1727 microversion: 2.20 time: 0.169871 May 26 14:06:47.818699 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 603/1167] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:47 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:48.835992 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c9340d02-5177-4238-8a79-16aef8260892 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:48.836575 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c9340d02-5177-4238-8a79-16aef8260892 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:48.843887 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c9340d02-5177-4238-8a79-16aef8260892 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:48.844332 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c9340d02-5177-4238-8a79-16aef8260892 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:48.845091 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c9340d02-5177-4238-8a79-16aef8260892 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:48.845557 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c9340d02-5177-4238-8a79-16aef8260892 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:48.974764 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c9340d02-5177-4238-8a79-16aef8260892 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:48.982988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c9340d02-5177-4238-8a79-16aef8260892 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:48.984523 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c9340d02-5177-4238-8a79-16aef8260892 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:48.985765 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c9340d02-5177-4238-8a79-16aef8260892 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1727 microversion: 2.20 time: 0.153723 May 26 14:06:48.986343 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 565/1168] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:48 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:49.058527 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f68ef8f8-5eff-4060-8fad-6ffb044239d2 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:49.059037 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f68ef8f8-5eff-4060-8fad-6ffb044239d2 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:49.065667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f68ef8f8-5eff-4060-8fad-6ffb044239d2 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:49.066118 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f68ef8f8-5eff-4060-8fad-6ffb044239d2 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:49.066884 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f68ef8f8-5eff-4060-8fad-6ffb044239d2 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:49.067320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f68ef8f8-5eff-4060-8fad-6ffb044239d2 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:49.090296 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f68ef8f8-5eff-4060-8fad-6ffb044239d2 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a/ips" status: 200 len: 145 microversion: 2.1 time: 0.035660 May 26 14:06:49.090784 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 604/1169] 10.222.0.91 () {58 vars in 1247 bytes} [Thu May 26 14:06:49 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:06:50.007927 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-541797a8-25cc-4bbb-9b92-237a5d1593fc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:50.008395 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-541797a8-25cc-4bbb-9b92-237a5d1593fc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:50.014883 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-541797a8-25cc-4bbb-9b92-237a5d1593fc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:50.015609 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-541797a8-25cc-4bbb-9b92-237a5d1593fc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:50.016566 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-541797a8-25cc-4bbb-9b92-237a5d1593fc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:50.017557 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-541797a8-25cc-4bbb-9b92-237a5d1593fc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:50.159595 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-541797a8-25cc-4bbb-9b92-237a5d1593fc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:50.167624 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-541797a8-25cc-4bbb-9b92-237a5d1593fc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:50.169075 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-541797a8-25cc-4bbb-9b92-237a5d1593fc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:50.170826 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-541797a8-25cc-4bbb-9b92-237a5d1593fc tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1727 microversion: 2.20 time: 0.166758 May 26 14:06:50.171454 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 566/1170] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:50 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:51.117051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c63a4a8e-68f1-40bc-8ed5-26aadbe43d65 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e1099d7-acf5-4312-bfd3-e5a1e299cbce"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:06:51.118244 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c63a4a8e-68f1-40bc-8ed5-26aadbe43d65 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:51.125431 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c63a4a8e-68f1-40bc-8ed5-26aadbe43d65 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:51.125877 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c63a4a8e-68f1-40bc-8ed5-26aadbe43d65 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:51.126635 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c63a4a8e-68f1-40bc-8ed5-26aadbe43d65 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:51.127065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c63a4a8e-68f1-40bc-8ed5-26aadbe43d65 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:51.194779 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d8948d92-0d1f-4288-b4cc-16d18b4e9ba2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:51.196594 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d8948d92-0d1f-4288-b4cc-16d18b4e9ba2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:51.203126 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d8948d92-0d1f-4288-b4cc-16d18b4e9ba2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:51.203665 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d8948d92-0d1f-4288-b4cc-16d18b4e9ba2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:51.204517 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d8948d92-0d1f-4288-b4cc-16d18b4e9ba2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:51.205059 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d8948d92-0d1f-4288-b4cc-16d18b4e9ba2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:51.346504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d8948d92-0d1f-4288-b4cc-16d18b4e9ba2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:51.355099 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d8948d92-0d1f-4288-b4cc-16d18b4e9ba2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:51.356607 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d8948d92-0d1f-4288-b4cc-16d18b4e9ba2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:51.358327 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d8948d92-0d1f-4288-b4cc-16d18b4e9ba2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1727 microversion: 2.20 time: 0.172888 May 26 14:06:51.358894 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 567/1171] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:51 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:51.410504 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c63a4a8e-68f1-40bc-8ed5-26aadbe43d65 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "POST /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297306 May 26 14:06:51.411332 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 605/1172] 10.222.0.91 () {60 vars in 1322 bytes} [Thu May 26 14:06:51 2022] POST /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:06:52.382833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-52e2e490-91b6-41eb-9f9a-7523d41b5c30 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:52.383804 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-52e2e490-91b6-41eb-9f9a-7523d41b5c30 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:52.392012 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-52e2e490-91b6-41eb-9f9a-7523d41b5c30 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:52.392464 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-52e2e490-91b6-41eb-9f9a-7523d41b5c30 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:52.393302 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-52e2e490-91b6-41eb-9f9a-7523d41b5c30 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:52.393834 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-52e2e490-91b6-41eb-9f9a-7523d41b5c30 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:52.544310 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-52e2e490-91b6-41eb-9f9a-7523d41b5c30 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:52.552871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-52e2e490-91b6-41eb-9f9a-7523d41b5c30 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:52.554397 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-52e2e490-91b6-41eb-9f9a-7523d41b5c30 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:52.555569 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-52e2e490-91b6-41eb-9f9a-7523d41b5c30 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1727 microversion: 2.20 time: 0.180477 May 26 14:06:52.556129 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 568/1173] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:52 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1727 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:53.574683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a3613106-bb80-46c0-b216-bc50113412d3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:53.576052 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a3613106-bb80-46c0-b216-bc50113412d3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:53.584986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a3613106-bb80-46c0-b216-bc50113412d3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:53.585272 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a3613106-bb80-46c0-b216-bc50113412d3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:53.586058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a3613106-bb80-46c0-b216-bc50113412d3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:53.586497 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a3613106-bb80-46c0-b216-bc50113412d3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:53.723014 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a3613106-bb80-46c0-b216-bc50113412d3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:53.731383 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a3613106-bb80-46c0-b216-bc50113412d3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:53.733605 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a3613106-bb80-46c0-b216-bc50113412d3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:53.734796 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a3613106-bb80-46c0-b216-bc50113412d3 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1727 microversion: 2.20 time: 0.164420 May 26 14:06:53.735394 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 606/1174] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:53 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:53.932240 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-e6b4fd51-df97-44bb-b125-cfb8a2a74cd1 req-0092fa51-81c7-4d05-8b7e-546ec9eec57e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7", "name": "network-vif-plugged", "status": "completed", "tag": "703563f0-f1dc-4261-919d-1995757e7da5"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:06:53.940322 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-e6b4fd51-df97-44bb-b125-cfb8a2a74cd1 req-0092fa51-81c7-4d05-8b7e-546ec9eec57e service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:53.940763 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-e6b4fd51-df97-44bb-b125-cfb8a2a74cd1 req-0092fa51-81c7-4d05-8b7e-546ec9eec57e service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:53.951613 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-e6b4fd51-df97-44bb-b125-cfb8a2a74cd1 req-0092fa51-81c7-4d05-8b7e-546ec9eec57e service nova] Creating event network-vif-plugged:703563f0-f1dc-4261-919d-1995757e7da5 for instance 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 on hv-cinder-84213 May 26 14:06:53.956758 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-e6b4fd51-df97-44bb-b125-cfb8a2a74cd1 req-0092fa51-81c7-4d05-8b7e-546ec9eec57e service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222723 May 26 14:06:53.957376 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 569/1175] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:06:54.752750 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c36dd7ef-9864-4d55-b0d1-522c43a8e4d9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:54.753391 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c36dd7ef-9864-4d55-b0d1-522c43a8e4d9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:54.760001 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c36dd7ef-9864-4d55-b0d1-522c43a8e4d9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:54.760444 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c36dd7ef-9864-4d55-b0d1-522c43a8e4d9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:54.761241 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c36dd7ef-9864-4d55-b0d1-522c43a8e4d9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:54.761676 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c36dd7ef-9864-4d55-b0d1-522c43a8e4d9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:54.898144 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c36dd7ef-9864-4d55-b0d1-522c43a8e4d9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:54.901660 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:06:54.907188 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c36dd7ef-9864-4d55-b0d1-522c43a8e4d9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:54.908593 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c36dd7ef-9864-4d55-b0d1-522c43a8e4d9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:54.909791 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c36dd7ef-9864-4d55-b0d1-522c43a8e4d9 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1727 microversion: 2.20 time: 0.160964 May 26 14:06:54.910349 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 607/1176] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:54 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:55.929350 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4a91d42e-11ff-4065-b752-3112a256f917 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:55.929976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4a91d42e-11ff-4065-b752-3112a256f917 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:55.936091 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4a91d42e-11ff-4065-b752-3112a256f917 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:55.937023 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4a91d42e-11ff-4065-b752-3112a256f917 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:55.937818 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4a91d42e-11ff-4065-b752-3112a256f917 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:55.938249 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4a91d42e-11ff-4065-b752-3112a256f917 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:56.089970 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4a91d42e-11ff-4065-b752-3112a256f917 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:56.102843 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4a91d42e-11ff-4065-b752-3112a256f917 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:56.104569 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4a91d42e-11ff-4065-b752-3112a256f917 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:56.106259 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4a91d42e-11ff-4065-b752-3112a256f917 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1727 microversion: 2.20 time: 0.181411 May 26 14:06:56.106620 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 570/1177] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:55 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1727 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:06:57.127775 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9dc15ead-a1ac-4e92-9fb1-05649210c88b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:57.128462 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9dc15ead-a1ac-4e92-9fb1-05649210c88b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:57.131328 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=40 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:06:57.136964 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9dc15ead-a1ac-4e92-9fb1-05649210c88b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:57.137446 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9dc15ead-a1ac-4e92-9fb1-05649210c88b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:57.138215 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9dc15ead-a1ac-4e92-9fb1-05649210c88b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:57.138974 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9dc15ead-a1ac-4e92-9fb1-05649210c88b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:57.270517 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9dc15ead-a1ac-4e92-9fb1-05649210c88b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:57.278423 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9dc15ead-a1ac-4e92-9fb1-05649210c88b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:57.279919 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9dc15ead-a1ac-4e92-9fb1-05649210c88b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:57.281655 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9dc15ead-a1ac-4e92-9fb1-05649210c88b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1714 microversion: 2.20 time: 0.157902 May 26 14:06:57.282210 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 608/1178] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:06:57 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1714 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:06:58.915385 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c017c440-284c-49f8-866d-cd5c4a95037b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:06:58.922046 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c017c440-284c-49f8-866d-cd5c4a95037b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:58.922500 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c017c440-284c-49f8-866d-cd5c4a95037b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:58.981708 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c017c440-284c-49f8-866d-cd5c4a95037b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Going to try to stop instance {{(pid=117787) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 14:06:59.025906 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c017c440-284c-49f8-866d-cd5c4a95037b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "POST /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a/action" status: 202 len: 0 microversion: 2.1 time: 0.114163 May 26 14:06:59.026534 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 571/1179] 10.222.0.91 () {60 vars in 1277 bytes} [Thu May 26 14:06:58 2022] POST /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:06:59.034583 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3a43ddc4-573f-44d6-bace-cad615bcfca6 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:06:59.035187 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3a43ddc4-573f-44d6-bace-cad615bcfca6 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:06:59.041817 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3a43ddc4-573f-44d6-bace-cad615bcfca6 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:59.042248 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3a43ddc4-573f-44d6-bace-cad615bcfca6 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:59.043105 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3a43ddc4-573f-44d6-bace-cad615bcfca6 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:06:59.043541 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3a43ddc4-573f-44d6-bace-cad615bcfca6 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:06:59.174115 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3a43ddc4-573f-44d6-bace-cad615bcfca6 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:06:59.182140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3a43ddc4-573f-44d6-bace-cad615bcfca6 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1722 microversion: 2.1 time: 0.151271 May 26 14:06:59.182710 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 609/1180] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:06:59 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:07:00.203497 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-90819c5d-d1e8-4e47-b842-95bd2ecf5435 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:00.204180 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-90819c5d-d1e8-4e47-b842-95bd2ecf5435 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:00.210311 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-90819c5d-d1e8-4e47-b842-95bd2ecf5435 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:00.210751 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-90819c5d-d1e8-4e47-b842-95bd2ecf5435 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:00.211501 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-90819c5d-d1e8-4e47-b842-95bd2ecf5435 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:00.211928 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-90819c5d-d1e8-4e47-b842-95bd2ecf5435 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:00.214590 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:07:00.347314 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-90819c5d-d1e8-4e47-b842-95bd2ecf5435 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:00.355148 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-90819c5d-d1e8-4e47-b842-95bd2ecf5435 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1722 microversion: 2.1 time: 0.156418 May 26 14:07:00.355712 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 572/1181] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:00 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:01.372490 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c58061de-40e2-495c-93dd-48d061ae6641 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:01.373021 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c58061de-40e2-495c-93dd-48d061ae6641 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:01.379684 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c58061de-40e2-495c-93dd-48d061ae6641 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:01.380161 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c58061de-40e2-495c-93dd-48d061ae6641 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:01.380929 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c58061de-40e2-495c-93dd-48d061ae6641 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:01.381399 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c58061de-40e2-495c-93dd-48d061ae6641 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:01.507898 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c58061de-40e2-495c-93dd-48d061ae6641 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:01.516694 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c58061de-40e2-495c-93dd-48d061ae6641 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1722 microversion: 2.1 time: 0.148153 May 26 14:07:01.517285 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 610/1182] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:01 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:02.533779 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-911bb553-c891-4cd0-a0c1-2eecc6bdcd96 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:02.534381 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-911bb553-c891-4cd0-a0c1-2eecc6bdcd96 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:02.540778 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-911bb553-c891-4cd0-a0c1-2eecc6bdcd96 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:02.541263 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-911bb553-c891-4cd0-a0c1-2eecc6bdcd96 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:02.542032 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-911bb553-c891-4cd0-a0c1-2eecc6bdcd96 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:02.542473 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-911bb553-c891-4cd0-a0c1-2eecc6bdcd96 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:02.671229 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-911bb553-c891-4cd0-a0c1-2eecc6bdcd96 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:02.679014 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-911bb553-c891-4cd0-a0c1-2eecc6bdcd96 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1722 microversion: 2.1 time: 0.149300 May 26 14:07:02.679577 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 573/1183] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:02 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:03.696500 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e6d84eb9-14b4-4617-8f78-2825b3bd24a2 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:03.697126 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e6d84eb9-14b4-4617-8f78-2825b3bd24a2 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:03.704482 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e6d84eb9-14b4-4617-8f78-2825b3bd24a2 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:03.704934 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e6d84eb9-14b4-4617-8f78-2825b3bd24a2 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:03.705735 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e6d84eb9-14b4-4617-8f78-2825b3bd24a2 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:03.706177 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e6d84eb9-14b4-4617-8f78-2825b3bd24a2 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:03.858532 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e6d84eb9-14b4-4617-8f78-2825b3bd24a2 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:03.866487 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e6d84eb9-14b4-4617-8f78-2825b3bd24a2 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1722 microversion: 2.1 time: 0.173890 May 26 14:07:03.867061 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 611/1184] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:03 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:04.883874 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2036e3fc-6a64-47ea-8848-f575f57585a8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:04.884473 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2036e3fc-6a64-47ea-8848-f575f57585a8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:04.891168 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2036e3fc-6a64-47ea-8848-f575f57585a8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:04.891611 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2036e3fc-6a64-47ea-8848-f575f57585a8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:04.892361 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2036e3fc-6a64-47ea-8848-f575f57585a8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:04.892788 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2036e3fc-6a64-47ea-8848-f575f57585a8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:05.022188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2036e3fc-6a64-47ea-8848-f575f57585a8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:05.030655 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2036e3fc-6a64-47ea-8848-f575f57585a8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1722 microversion: 2.1 time: 0.150205 May 26 14:07:05.031210 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 574/1185] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:04 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:06.048253 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-178bf2af-a9b7-4989-9392-efebbc10bd12 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:06.048867 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-178bf2af-a9b7-4989-9392-efebbc10bd12 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:06.055480 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-178bf2af-a9b7-4989-9392-efebbc10bd12 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:06.055934 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-178bf2af-a9b7-4989-9392-efebbc10bd12 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:06.056705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-178bf2af-a9b7-4989-9392-efebbc10bd12 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:06.057144 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-178bf2af-a9b7-4989-9392-efebbc10bd12 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:06.183866 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-178bf2af-a9b7-4989-9392-efebbc10bd12 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:06.197984 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-178bf2af-a9b7-4989-9392-efebbc10bd12 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1722 microversion: 2.1 time: 0.154143 May 26 14:07:06.198600 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 612/1186] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:06 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:07.215310 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8ffa652f-7eb3-4ee5-907a-331f5af65d2c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:07.215959 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8ffa652f-7eb3-4ee5-907a-331f5af65d2c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:07.218368 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=30 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:07:07.223999 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8ffa652f-7eb3-4ee5-907a-331f5af65d2c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:07.224453 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8ffa652f-7eb3-4ee5-907a-331f5af65d2c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:07.225257 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8ffa652f-7eb3-4ee5-907a-331f5af65d2c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:07.225702 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8ffa652f-7eb3-4ee5-907a-331f5af65d2c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:07.352150 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8ffa652f-7eb3-4ee5-907a-331f5af65d2c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:07.360083 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8ffa652f-7eb3-4ee5-907a-331f5af65d2c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1722 microversion: 2.1 time: 0.148621 May 26 14:07:07.360651 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 575/1187] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:07 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:08.377073 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9456587c-ca63-43ce-9c53-36e7f7bc4742 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:08.377705 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9456587c-ca63-43ce-9c53-36e7f7bc4742 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:08.384136 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9456587c-ca63-43ce-9c53-36e7f7bc4742 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:08.384583 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9456587c-ca63-43ce-9c53-36e7f7bc4742 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:08.385368 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9456587c-ca63-43ce-9c53-36e7f7bc4742 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:08.385801 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9456587c-ca63-43ce-9c53-36e7f7bc4742 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:08.515339 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9456587c-ca63-43ce-9c53-36e7f7bc4742 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:08.524343 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9456587c-ca63-43ce-9c53-36e7f7bc4742 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1722 microversion: 2.1 time: 0.151140 May 26 14:07:08.524909 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 613/1188] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:08 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:09.542309 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e095f347-9a3b-4c72-ad6d-1e29b566bb9f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:09.542915 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e095f347-9a3b-4c72-ad6d-1e29b566bb9f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:09.549984 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e095f347-9a3b-4c72-ad6d-1e29b566bb9f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:09.550431 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e095f347-9a3b-4c72-ad6d-1e29b566bb9f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:09.551186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e095f347-9a3b-4c72-ad6d-1e29b566bb9f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:09.551618 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e095f347-9a3b-4c72-ad6d-1e29b566bb9f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:09.676891 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e095f347-9a3b-4c72-ad6d-1e29b566bb9f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:09.684759 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e095f347-9a3b-4c72-ad6d-1e29b566bb9f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1722 microversion: 2.1 time: 0.146336 May 26 14:07:09.685361 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 576/1189] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:09 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:10.701834 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4cce54f0-66fe-4e71-8677-ebf4b6bf30a2 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:10.702479 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4cce54f0-66fe-4e71-8677-ebf4b6bf30a2 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:10.709143 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4cce54f0-66fe-4e71-8677-ebf4b6bf30a2 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:10.709628 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4cce54f0-66fe-4e71-8677-ebf4b6bf30a2 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:10.710430 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4cce54f0-66fe-4e71-8677-ebf4b6bf30a2 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:10.710874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4cce54f0-66fe-4e71-8677-ebf4b6bf30a2 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:10.838914 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4cce54f0-66fe-4e71-8677-ebf4b6bf30a2 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:10.846929 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4cce54f0-66fe-4e71-8677-ebf4b6bf30a2 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1722 microversion: 2.1 time: 0.149013 May 26 14:07:10.847504 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 614/1190] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:10 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:11.863867 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-06f8b3ce-9d95-4d6b-ba65-47f28a3c37ac tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:11.864486 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-06f8b3ce-9d95-4d6b-ba65-47f28a3c37ac tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:11.871996 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-06f8b3ce-9d95-4d6b-ba65-47f28a3c37ac tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:11.872592 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-06f8b3ce-9d95-4d6b-ba65-47f28a3c37ac tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:11.874016 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-06f8b3ce-9d95-4d6b-ba65-47f28a3c37ac tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:11.874839 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-06f8b3ce-9d95-4d6b-ba65-47f28a3c37ac tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:12.025670 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-06f8b3ce-9d95-4d6b-ba65-47f28a3c37ac tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:12.035009 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-06f8b3ce-9d95-4d6b-ba65-47f28a3c37ac tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1722 microversion: 2.1 time: 0.174992 May 26 14:07:12.044791 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 577/1191] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:11 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:13.051908 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ee916fd5-cf2c-4dd6-96c3-9e1178f4ab25 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:13.052520 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ee916fd5-cf2c-4dd6-96c3-9e1178f4ab25 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:13.059201 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ee916fd5-cf2c-4dd6-96c3-9e1178f4ab25 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:13.059659 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ee916fd5-cf2c-4dd6-96c3-9e1178f4ab25 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:13.060430 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ee916fd5-cf2c-4dd6-96c3-9e1178f4ab25 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:13.061462 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ee916fd5-cf2c-4dd6-96c3-9e1178f4ab25 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:13.128578 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ef322e17-7b9a-41ad-96b3-6d42d263e6ab tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2137462297", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-886850747", "security_groups": [{"name": "tempest-secgroup-smoke-1274687408"}], "block_device_mapping_v2": [{"uuid": "98009a7e-306e-40cb-a939-ea03822c1ad2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bb3bf56d-90fc-4a74-995d-ab2752db975c"}]}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:07:13.195393 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ee916fd5-cf2c-4dd6-96c3-9e1178f4ab25 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:13.203529 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ee916fd5-cf2c-4dd6-96c3-9e1178f4ab25 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1722 microversion: 2.1 time: 0.155367 May 26 14:07:13.204109 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 615/1192] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:13 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:13.242408 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-ef322e17-7b9a-41ad-96b3-6d42d263e6ab tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] validate_networks() for [('bb3bf56d-90fc-4a74-995d-ab2752db975c', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 14:07:13.655398 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-ef322e17-7b9a-41ad-96b3-6d42d263e6ab tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 14:07:13.655819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-ef322e17-7b9a-41ad-96b3-6d42d263e6ab tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 14:07:13.656301 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-ef322e17-7b9a-41ad-96b3-6d42d263e6ab tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 14:07:13.656699 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-ef322e17-7b9a-41ad-96b3-6d42d263e6ab tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 14:07:13.657112 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-ef322e17-7b9a-41ad-96b3-6d42d263e6ab tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 14:07:13.665826 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ef322e17-7b9a-41ad-96b3-6d42d263e6ab tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:13.666274 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ef322e17-7b9a-41ad-96b3-6d42d263e6ab tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:13.667069 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ef322e17-7b9a-41ad-96b3-6d42d263e6ab tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:13.667510 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ef322e17-7b9a-41ad-96b3-6d42d263e6ab tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:13.683919 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-ef322e17-7b9a-41ad-96b3-6d42d263e6ab tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Getting quotas for project ed15631acafd41528b96f2ed12c19e5b. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 14:07:13.687886 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-ef322e17-7b9a-41ad-96b3-6d42d263e6ab tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Getting quotas for user 5068f06b1a8e47b88ba3294169545aa3 and project ed15631acafd41528b96f2ed12c19e5b. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 14:07:13.746000 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ef322e17-7b9a-41ad-96b3-6d42d263e6ab tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 14:07:13.748163 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ef322e17-7b9a-41ad-96b3-6d42d263e6ab tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 75f06b3a-5413-4231-9d67-79c5f7f45b62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='98009a7e-306e-40cb-a939-ea03822c1ad2',volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 14:07:13.879123 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ef322e17-7b9a-41ad-96b3-6d42d263e6ab tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.754264 May 26 14:07:13.879758 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 578/1193] 10.222.0.91 () {60 vars in 1146 bytes} [Thu May 26 14:07:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 14:07:13.890355 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-978bf7be-2a8f-4691-87b1-317b989b653d tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:13.890958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-978bf7be-2a8f-4691-87b1-317b989b653d tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 75f06b3a-5413-4231-9d67-79c5f7f45b62] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:13.944437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-978bf7be-2a8f-4691-87b1-317b989b653d tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:13.952397 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-978bf7be-2a8f-4691-87b1-317b989b653d tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62" status: 200 len: 1094 microversion: 2.1 time: 0.066036 May 26 14:07:13.952903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 616/1194] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:13 2022] GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:14.220644 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f91d799f-5ff7-4b87-bb98-f45b3a666ad0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:14.221276 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f91d799f-5ff7-4b87-bb98-f45b3a666ad0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:14.227439 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f91d799f-5ff7-4b87-bb98-f45b3a666ad0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:14.227887 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f91d799f-5ff7-4b87-bb98-f45b3a666ad0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:14.228644 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f91d799f-5ff7-4b87-bb98-f45b3a666ad0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:14.229078 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f91d799f-5ff7-4b87-bb98-f45b3a666ad0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:14.356890 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f91d799f-5ff7-4b87-bb98-f45b3a666ad0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:14.366281 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f91d799f-5ff7-4b87-bb98-f45b3a666ad0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1722 microversion: 2.1 time: 0.149900 May 26 14:07:14.366958 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 579/1195] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:14 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:14.971238 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a4d67d6d-19a7-403a-8f13-b0145bd2c5f4 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:14.973309 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a4d67d6d-19a7-403a-8f13-b0145bd2c5f4 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 75f06b3a-5413-4231-9d67-79c5f7f45b62] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:14.980112 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a4d67d6d-19a7-403a-8f13-b0145bd2c5f4 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:14.980663 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a4d67d6d-19a7-403a-8f13-b0145bd2c5f4 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:14.981583 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a4d67d6d-19a7-403a-8f13-b0145bd2c5f4 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:14.982096 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a4d67d6d-19a7-403a-8f13-b0145bd2c5f4 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:15.051138 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a4d67d6d-19a7-403a-8f13-b0145bd2c5f4 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:15.058830 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a4d67d6d-19a7-403a-8f13-b0145bd2c5f4 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62" status: 200 len: 1200 microversion: 2.1 time: 0.093370 May 26 14:07:15.059771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 617/1196] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:14 2022] GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62 => generated 1200 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:15.383960 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-34281656-5fa1-4120-ba92-634b1dfa6779 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:15.384576 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-34281656-5fa1-4120-ba92-634b1dfa6779 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:15.392907 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-34281656-5fa1-4120-ba92-634b1dfa6779 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:15.399157 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-34281656-5fa1-4120-ba92-634b1dfa6779 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:15.399157 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-34281656-5fa1-4120-ba92-634b1dfa6779 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:15.399157 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-34281656-5fa1-4120-ba92-634b1dfa6779 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:15.545346 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-34281656-5fa1-4120-ba92-634b1dfa6779 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:15.553811 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-34281656-5fa1-4120-ba92-634b1dfa6779 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1722 microversion: 2.1 time: 0.173641 May 26 14:07:15.554407 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 580/1197] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:15 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:16.076868 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9a0cde3b-7cab-4be6-83cc-20439375bafa tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:16.077818 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9a0cde3b-7cab-4be6-83cc-20439375bafa tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 75f06b3a-5413-4231-9d67-79c5f7f45b62] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:16.086281 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a0cde3b-7cab-4be6-83cc-20439375bafa tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:16.086738 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a0cde3b-7cab-4be6-83cc-20439375bafa tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:16.087527 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a0cde3b-7cab-4be6-83cc-20439375bafa tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:16.087973 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a0cde3b-7cab-4be6-83cc-20439375bafa tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:16.255275 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9a0cde3b-7cab-4be6-83cc-20439375bafa tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:16.263939 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9a0cde3b-7cab-4be6-83cc-20439375bafa tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62" status: 200 len: 1266 microversion: 2.1 time: 0.191687 May 26 14:07:16.265971 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 618/1198] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:16 2022] GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:16.480910 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-a9955e0b-aa5c-4bc6-83f9-868779a6909d req-9d8da842-c14e-437a-b964-5d9c8d586b05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75f06b3a-5413-4231-9d67-79c5f7f45b62", "tag": "70c52bfb-dbc8-4c34-9c1c-2176592f141a"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:07:16.489659 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-a9955e0b-aa5c-4bc6-83f9-868779a6909d req-9d8da842-c14e-437a-b964-5d9c8d586b05 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:16.490634 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-a9955e0b-aa5c-4bc6-83f9-868779a6909d req-9d8da842-c14e-437a-b964-5d9c8d586b05 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:16.503136 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-a9955e0b-aa5c-4bc6-83f9-868779a6909d req-9d8da842-c14e-437a-b964-5d9c8d586b05 service nova] Creating event network-changed:70c52bfb-dbc8-4c34-9c1c-2176592f141a for instance 75f06b3a-5413-4231-9d67-79c5f7f45b62 on hv-cinder-84213 May 26 14:07:16.508284 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-a9955e0b-aa5c-4bc6-83f9-868779a6909d req-9d8da842-c14e-437a-b964-5d9c8d586b05 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100171 May 26 14:07:16.509191 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 581/1199] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:07:16.571464 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b4614da4-f48b-4caa-aa93-d5458ae2167c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:16.572276 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b4614da4-f48b-4caa-aa93-d5458ae2167c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:16.578806 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b4614da4-f48b-4caa-aa93-d5458ae2167c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:16.579279 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b4614da4-f48b-4caa-aa93-d5458ae2167c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:16.580136 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b4614da4-f48b-4caa-aa93-d5458ae2167c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:16.580578 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b4614da4-f48b-4caa-aa93-d5458ae2167c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:16.724072 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b4614da4-f48b-4caa-aa93-d5458ae2167c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:16.732165 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b4614da4-f48b-4caa-aa93-d5458ae2167c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1722 microversion: 2.1 time: 0.164574 May 26 14:07:16.733289 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 619/1200] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:16 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:17.283326 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0f92e590-8ef3-4ad4-9538-cf68b98a2188 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:17.284018 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0f92e590-8ef3-4ad4-9538-cf68b98a2188 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 75f06b3a-5413-4231-9d67-79c5f7f45b62] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:17.290245 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f92e590-8ef3-4ad4-9538-cf68b98a2188 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:17.290696 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f92e590-8ef3-4ad4-9538-cf68b98a2188 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:17.291481 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f92e590-8ef3-4ad4-9538-cf68b98a2188 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:17.291916 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f92e590-8ef3-4ad4-9538-cf68b98a2188 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:17.418369 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0f92e590-8ef3-4ad4-9538-cf68b98a2188 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:17.428299 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0f92e590-8ef3-4ad4-9538-cf68b98a2188 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62" status: 200 len: 1266 microversion: 2.1 time: 0.149756 May 26 14:07:17.428872 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 582/1201] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:17 2022] GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:17.750449 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e8aab0dd-5737-4e21-a383-f311fcb45881 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:17.751057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e8aab0dd-5737-4e21-a383-f311fcb45881 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:17.757539 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e8aab0dd-5737-4e21-a383-f311fcb45881 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:17.757992 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e8aab0dd-5737-4e21-a383-f311fcb45881 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:17.758749 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e8aab0dd-5737-4e21-a383-f311fcb45881 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:17.759306 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e8aab0dd-5737-4e21-a383-f311fcb45881 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:17.890211 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e8aab0dd-5737-4e21-a383-f311fcb45881 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:17.898065 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e8aab0dd-5737-4e21-a383-f311fcb45881 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1722 microversion: 2.1 time: 0.152163 May 26 14:07:17.898639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 620/1202] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:17 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:18.444610 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-074c6906-71d7-438c-834e-4704eaab143b tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:18.445402 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-074c6906-71d7-438c-834e-4704eaab143b tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 75f06b3a-5413-4231-9d67-79c5f7f45b62] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:18.452019 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-074c6906-71d7-438c-834e-4704eaab143b tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:18.452460 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-074c6906-71d7-438c-834e-4704eaab143b tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:18.453261 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-074c6906-71d7-438c-834e-4704eaab143b tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:18.453692 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-074c6906-71d7-438c-834e-4704eaab143b tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:18.589879 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-074c6906-71d7-438c-834e-4704eaab143b tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:18.598033 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-074c6906-71d7-438c-834e-4704eaab143b tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62" status: 200 len: 1266 microversion: 2.1 time: 0.157223 May 26 14:07:18.598612 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 583/1203] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:18 2022] GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:18.916160 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8d0c95f1-51c6-4b63-9826-239192cb1f47 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:18.916759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8d0c95f1-51c6-4b63-9826-239192cb1f47 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:18.923938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8d0c95f1-51c6-4b63-9826-239192cb1f47 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:18.924395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8d0c95f1-51c6-4b63-9826-239192cb1f47 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:18.925194 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8d0c95f1-51c6-4b63-9826-239192cb1f47 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:18.925636 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8d0c95f1-51c6-4b63-9826-239192cb1f47 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:19.067946 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8d0c95f1-51c6-4b63-9826-239192cb1f47 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:19.076140 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8d0c95f1-51c6-4b63-9826-239192cb1f47 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1722 microversion: 2.1 time: 0.163881 May 26 14:07:19.076715 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 621/1204] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:18 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:19.617592 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0512d809-28a5-42a1-8072-9c606961c2e5 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:19.618235 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0512d809-28a5-42a1-8072-9c606961c2e5 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 75f06b3a-5413-4231-9d67-79c5f7f45b62] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:19.625515 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0512d809-28a5-42a1-8072-9c606961c2e5 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:19.625966 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0512d809-28a5-42a1-8072-9c606961c2e5 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:19.626742 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0512d809-28a5-42a1-8072-9c606961c2e5 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:19.627202 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0512d809-28a5-42a1-8072-9c606961c2e5 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:19.762491 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0512d809-28a5-42a1-8072-9c606961c2e5 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:19.770243 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0512d809-28a5-42a1-8072-9c606961c2e5 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62" status: 200 len: 1266 microversion: 2.1 time: 0.156476 May 26 14:07:19.770835 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 584/1205] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:19 2022] GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:20.093132 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e6b2b0f0-164d-4a0e-8057-ae540db525e9 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:20.093753 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e6b2b0f0-164d-4a0e-8057-ae540db525e9 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:20.100270 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e6b2b0f0-164d-4a0e-8057-ae540db525e9 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:20.100722 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e6b2b0f0-164d-4a0e-8057-ae540db525e9 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:20.101586 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e6b2b0f0-164d-4a0e-8057-ae540db525e9 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:20.101965 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e6b2b0f0-164d-4a0e-8057-ae540db525e9 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:20.235370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e6b2b0f0-164d-4a0e-8057-ae540db525e9 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:20.244132 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e6b2b0f0-164d-4a0e-8057-ae540db525e9 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1699 microversion: 2.1 time: 0.155320 May 26 14:07:20.244722 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 622/1206] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:20 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1699 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:20.260282 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-50255168-a76c-4064-adbf-9ea3e111e76d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:07:20.267344 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-50255168-a76c-4064-adbf-9ea3e111e76d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:20.267792 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-50255168-a76c-4064-adbf-9ea3e111e76d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:20.290291 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-50255168-a76c-4064-adbf-9ea3e111e76d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Going to try to start instance {{(pid=117787) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 14:07:20.333658 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-50255168-a76c-4064-adbf-9ea3e111e76d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "POST /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a/action" status: 202 len: 0 microversion: 2.1 time: 0.076964 May 26 14:07:20.334429 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 585/1207] 10.222.0.91 () {60 vars in 1277 bytes} [Thu May 26 14:07:20 2022] POST /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:07:20.343086 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7d2c034f-4c2f-4a8b-a162-7289bbe5f017 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:20.343852 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7d2c034f-4c2f-4a8b-a162-7289bbe5f017 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:20.349910 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7d2c034f-4c2f-4a8b-a162-7289bbe5f017 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:20.350400 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7d2c034f-4c2f-4a8b-a162-7289bbe5f017 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:20.351278 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7d2c034f-4c2f-4a8b-a162-7289bbe5f017 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:20.351718 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7d2c034f-4c2f-4a8b-a162-7289bbe5f017 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:20.485810 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7d2c034f-4c2f-4a8b-a162-7289bbe5f017 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:20.494559 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7d2c034f-4c2f-4a8b-a162-7289bbe5f017 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1708 microversion: 2.1 time: 0.155851 May 26 14:07:20.495147 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 623/1208] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:20 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1708 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:20.788040 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f9974baf-5b66-427b-ac3b-418f9ae0bd95 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:20.788741 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f9974baf-5b66-427b-ac3b-418f9ae0bd95 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 75f06b3a-5413-4231-9d67-79c5f7f45b62] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:20.795572 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f9974baf-5b66-427b-ac3b-418f9ae0bd95 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:20.796089 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f9974baf-5b66-427b-ac3b-418f9ae0bd95 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:20.796871 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f9974baf-5b66-427b-ac3b-418f9ae0bd95 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:20.797341 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f9974baf-5b66-427b-ac3b-418f9ae0bd95 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:20.929189 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f9974baf-5b66-427b-ac3b-418f9ae0bd95 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:20.937469 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f9974baf-5b66-427b-ac3b-418f9ae0bd95 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62" status: 200 len: 1266 microversion: 2.1 time: 0.153608 May 26 14:07:20.938261 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 586/1209] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:20 2022] GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:21.512131 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-63072366-bc9d-4640-9a80-e65e0b80688e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:21.512680 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-63072366-bc9d-4640-9a80-e65e0b80688e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:21.520102 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63072366-bc9d-4640-9a80-e65e0b80688e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:21.520548 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63072366-bc9d-4640-9a80-e65e0b80688e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:21.521346 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63072366-bc9d-4640-9a80-e65e0b80688e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:21.521783 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63072366-bc9d-4640-9a80-e65e0b80688e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:21.650238 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-63072366-bc9d-4640-9a80-e65e0b80688e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:21.658454 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-63072366-bc9d-4640-9a80-e65e0b80688e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1708 microversion: 2.1 time: 0.150373 May 26 14:07:21.659239 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 624/1210] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:21 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1708 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:07:21.954304 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6c77e6d7-4f09-4113-88c6-b46b42808d61 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:21.954945 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6c77e6d7-4f09-4113-88c6-b46b42808d61 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 75f06b3a-5413-4231-9d67-79c5f7f45b62] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:21.961729 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6c77e6d7-4f09-4113-88c6-b46b42808d61 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:21.962180 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6c77e6d7-4f09-4113-88c6-b46b42808d61 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:21.962943 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6c77e6d7-4f09-4113-88c6-b46b42808d61 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:21.963407 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6c77e6d7-4f09-4113-88c6-b46b42808d61 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:22.093618 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6c77e6d7-4f09-4113-88c6-b46b42808d61 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:22.101092 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6c77e6d7-4f09-4113-88c6-b46b42808d61 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62" status: 200 len: 1266 microversion: 2.1 time: 0.150737 May 26 14:07:22.101870 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 587/1211] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:21 2022] GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:22.676118 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-efed12b5-8c96-4fb2-9555-2b8401f89953 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:22.676756 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-efed12b5-8c96-4fb2-9555-2b8401f89953 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:22.683323 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-efed12b5-8c96-4fb2-9555-2b8401f89953 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:22.683771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-efed12b5-8c96-4fb2-9555-2b8401f89953 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:22.684532 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-efed12b5-8c96-4fb2-9555-2b8401f89953 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:22.684974 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-efed12b5-8c96-4fb2-9555-2b8401f89953 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:22.703103 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:07:22.811863 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-efed12b5-8c96-4fb2-9555-2b8401f89953 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:22.819655 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-efed12b5-8c96-4fb2-9555-2b8401f89953 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1712 microversion: 2.1 time: 0.147426 May 26 14:07:22.820211 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 625/1212] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:22 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1712 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:23.118525 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-37f971e0-ca27-4734-981e-728364bb45e0 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:23.119133 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-37f971e0-ca27-4734-981e-728364bb45e0 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 75f06b3a-5413-4231-9d67-79c5f7f45b62] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:23.126128 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37f971e0-ca27-4734-981e-728364bb45e0 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:23.126581 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37f971e0-ca27-4734-981e-728364bb45e0 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:23.127549 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37f971e0-ca27-4734-981e-728364bb45e0 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:23.127983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37f971e0-ca27-4734-981e-728364bb45e0 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:23.258848 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-37f971e0-ca27-4734-981e-728364bb45e0 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:23.267118 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-37f971e0-ca27-4734-981e-728364bb45e0 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62" status: 200 len: 1266 microversion: 2.1 time: 0.152460 May 26 14:07:23.267696 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 588/1213] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:23 2022] GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:24.285520 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a78a84ea-17c0-478a-abe1-9e306c7785e6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:24.286077 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a78a84ea-17c0-478a-abe1-9e306c7785e6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 75f06b3a-5413-4231-9d67-79c5f7f45b62] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:24.288516 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:07:24.294144 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a78a84ea-17c0-478a-abe1-9e306c7785e6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:24.294582 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a78a84ea-17c0-478a-abe1-9e306c7785e6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:24.295840 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a78a84ea-17c0-478a-abe1-9e306c7785e6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:24.296264 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a78a84ea-17c0-478a-abe1-9e306c7785e6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:24.425219 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a78a84ea-17c0-478a-abe1-9e306c7785e6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:24.432713 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a78a84ea-17c0-478a-abe1-9e306c7785e6 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62" status: 200 len: 1266 microversion: 2.1 time: 0.151396 May 26 14:07:24.433322 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 626/1214] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:24 2022] GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:25.449529 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a78a56cc-95cc-4010-9f43-05e5383e1b9e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:25.450146 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a78a56cc-95cc-4010-9f43-05e5383e1b9e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 75f06b3a-5413-4231-9d67-79c5f7f45b62] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:25.452727 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:07:25.453404 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=6 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:07:25.459910 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a78a56cc-95cc-4010-9f43-05e5383e1b9e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:25.460363 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a78a56cc-95cc-4010-9f43-05e5383e1b9e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:25.461135 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a78a56cc-95cc-4010-9f43-05e5383e1b9e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:25.461588 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a78a56cc-95cc-4010-9f43-05e5383e1b9e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:25.464302 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:07:25.593886 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a78a56cc-95cc-4010-9f43-05e5383e1b9e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:25.601265 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a78a56cc-95cc-4010-9f43-05e5383e1b9e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62" status: 200 len: 1266 microversion: 2.1 time: 0.155539 May 26 14:07:25.601831 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 589/1215] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:25 2022] GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:26.618640 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-39d5729c-a1bb-47b7-a3d8-d049d8ec1372 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:26.619376 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-39d5729c-a1bb-47b7-a3d8-d049d8ec1372 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 75f06b3a-5413-4231-9d67-79c5f7f45b62] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:26.626780 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-39d5729c-a1bb-47b7-a3d8-d049d8ec1372 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:26.628327 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-39d5729c-a1bb-47b7-a3d8-d049d8ec1372 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:26.628327 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-39d5729c-a1bb-47b7-a3d8-d049d8ec1372 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:26.628683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-39d5729c-a1bb-47b7-a3d8-d049d8ec1372 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:26.764752 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-39d5729c-a1bb-47b7-a3d8-d049d8ec1372 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:26.772552 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-39d5729c-a1bb-47b7-a3d8-d049d8ec1372 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62" status: 200 len: 1266 microversion: 2.1 time: 0.157684 May 26 14:07:26.773136 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 627/1216] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:26 2022] GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:27.790158 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3de3f940-eae8-4dc4-a789-4d89d5498751 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:27.790773 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3de3f940-eae8-4dc4-a789-4d89d5498751 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 75f06b3a-5413-4231-9d67-79c5f7f45b62] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:27.797421 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3de3f940-eae8-4dc4-a789-4d89d5498751 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:27.797878 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3de3f940-eae8-4dc4-a789-4d89d5498751 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:27.798769 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3de3f940-eae8-4dc4-a789-4d89d5498751 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:27.799215 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3de3f940-eae8-4dc4-a789-4d89d5498751 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:27.934291 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3de3f940-eae8-4dc4-a789-4d89d5498751 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:27.945789 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3de3f940-eae8-4dc4-a789-4d89d5498751 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62" status: 200 len: 1266 microversion: 2.1 time: 0.159212 May 26 14:07:27.946646 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 590/1217] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:27 2022] GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:28.000984 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-b6b58091-feb9-42ff-b90b-d16726b6d597 req-f3862d58-5a5d-4c60-9e03-161a543eeb79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75f06b3a-5413-4231-9d67-79c5f7f45b62", "name": "network-vif-plugged", "status": "completed", "tag": "70c52bfb-dbc8-4c34-9c1c-2176592f141a"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:07:28.004725 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=42 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:07:28.010967 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-b6b58091-feb9-42ff-b90b-d16726b6d597 req-f3862d58-5a5d-4c60-9e03-161a543eeb79 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:28.011450 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-b6b58091-feb9-42ff-b90b-d16726b6d597 req-f3862d58-5a5d-4c60-9e03-161a543eeb79 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:28.022962 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-b6b58091-feb9-42ff-b90b-d16726b6d597 req-f3862d58-5a5d-4c60-9e03-161a543eeb79 service nova] Creating event network-vif-plugged:70c52bfb-dbc8-4c34-9c1c-2176592f141a for instance 75f06b3a-5413-4231-9d67-79c5f7f45b62 on hv-cinder-84213 May 26 14:07:28.027962 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-b6b58091-feb9-42ff-b90b-d16726b6d597 req-f3862d58-5a5d-4c60-9e03-161a543eeb79 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031346 May 26 14:07:28.028549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 628/1218] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:07:28.966896 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3ea89e85-2523-4a8a-be9f-aa8e0a5f2cc3 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:28.967530 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3ea89e85-2523-4a8a-be9f-aa8e0a5f2cc3 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 75f06b3a-5413-4231-9d67-79c5f7f45b62] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:28.974331 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3ea89e85-2523-4a8a-be9f-aa8e0a5f2cc3 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:28.974730 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3ea89e85-2523-4a8a-be9f-aa8e0a5f2cc3 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:28.975502 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3ea89e85-2523-4a8a-be9f-aa8e0a5f2cc3 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:28.975981 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3ea89e85-2523-4a8a-be9f-aa8e0a5f2cc3 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:29.110520 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3ea89e85-2523-4a8a-be9f-aa8e0a5f2cc3 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:29.117898 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3ea89e85-2523-4a8a-be9f-aa8e0a5f2cc3 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62" status: 200 len: 1266 microversion: 2.1 time: 0.154956 May 26 14:07:29.118476 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 591/1219] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:28 2022] GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:30.136693 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-61876fa0-f9ab-4230-b413-a29c1621f7d7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:30.137417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-61876fa0-f9ab-4230-b413-a29c1621f7d7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 75f06b3a-5413-4231-9d67-79c5f7f45b62] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:30.144022 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-61876fa0-f9ab-4230-b413-a29c1621f7d7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:30.144471 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-61876fa0-f9ab-4230-b413-a29c1621f7d7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:30.145356 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-61876fa0-f9ab-4230-b413-a29c1621f7d7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:30.145781 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-61876fa0-f9ab-4230-b413-a29c1621f7d7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:30.274914 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-61876fa0-f9ab-4230-b413-a29c1621f7d7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:30.282478 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-61876fa0-f9ab-4230-b413-a29c1621f7d7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62" status: 200 len: 1266 microversion: 2.1 time: 0.150504 May 26 14:07:30.283219 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 629/1220] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:30 2022] GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:31.299803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-48032290-723b-49cc-a77e-44f8a9498f47 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:31.300485 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-48032290-723b-49cc-a77e-44f8a9498f47 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 75f06b3a-5413-4231-9d67-79c5f7f45b62] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:31.309492 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48032290-723b-49cc-a77e-44f8a9498f47 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:31.310418 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48032290-723b-49cc-a77e-44f8a9498f47 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:31.311187 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48032290-723b-49cc-a77e-44f8a9498f47 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:31.311618 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48032290-723b-49cc-a77e-44f8a9498f47 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:31.453932 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-48032290-723b-49cc-a77e-44f8a9498f47 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:31.461369 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-48032290-723b-49cc-a77e-44f8a9498f47 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62" status: 200 len: 1454 microversion: 2.1 time: 0.165532 May 26 14:07:31.461929 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 592/1221] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:31 2022] GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62 => generated 1454 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:31.477537 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-53a1a026-0d31-496c-9e27-e5b5f7cf1be9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:31.478156 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-53a1a026-0d31-496c-9e27-e5b5f7cf1be9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 75f06b3a-5413-4231-9d67-79c5f7f45b62] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:31.484683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-53a1a026-0d31-496c-9e27-e5b5f7cf1be9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:31.485129 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-53a1a026-0d31-496c-9e27-e5b5f7cf1be9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:31.485933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-53a1a026-0d31-496c-9e27-e5b5f7cf1be9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:31.486380 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-53a1a026-0d31-496c-9e27-e5b5f7cf1be9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:31.616627 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-53a1a026-0d31-496c-9e27-e5b5f7cf1be9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:31.624774 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-53a1a026-0d31-496c-9e27-e5b5f7cf1be9 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62" status: 200 len: 1454 microversion: 2.1 time: 0.151266 May 26 14:07:31.625383 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 630/1222] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:31 2022] GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62 => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:33.344358 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-813defa8-feb2-4462-8ede-8404213c647d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:33.344911 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-813defa8-feb2-4462-8ede-8404213c647d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:33.351443 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-813defa8-feb2-4462-8ede-8404213c647d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:33.351889 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-813defa8-feb2-4462-8ede-8404213c647d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:33.352653 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-813defa8-feb2-4462-8ede-8404213c647d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:33.353093 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-813defa8-feb2-4462-8ede-8404213c647d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:33.376900 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-813defa8-feb2-4462-8ede-8404213c647d tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d/ips" status: 200 len: 151 microversion: 2.1 time: 0.036925 May 26 14:07:33.377728 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 593/1223] 10.222.0.91 () {58 vars in 1247 bytes} [Thu May 26 14:07:33 2022] GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:07:33.586536 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-ffcc9fe1-00d2-488c-8b2c-64111aa539f8 req-36aa70cf-45e6-4e24-9912-713c2f931cae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75f06b3a-5413-4231-9d67-79c5f7f45b62", "tag": "70c52bfb-dbc8-4c34-9c1c-2176592f141a"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:07:33.597457 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-ffcc9fe1-00d2-488c-8b2c-64111aa539f8 req-36aa70cf-45e6-4e24-9912-713c2f931cae service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:33.597932 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-ffcc9fe1-00d2-488c-8b2c-64111aa539f8 req-36aa70cf-45e6-4e24-9912-713c2f931cae service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:33.620541 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-ffcc9fe1-00d2-488c-8b2c-64111aa539f8 req-36aa70cf-45e6-4e24-9912-713c2f931cae service nova] Creating event network-changed:70c52bfb-dbc8-4c34-9c1c-2176592f141a for instance 75f06b3a-5413-4231-9d67-79c5f7f45b62 on hv-cinder-84213 May 26 14:07:33.627447 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-ffcc9fe1-00d2-488c-8b2c-64111aa539f8 req-36aa70cf-45e6-4e24-9912-713c2f931cae service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045704 May 26 14:07:33.629145 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 631/1224] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:07:34.709417 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-902d89d9-f9c0-446b-8e59-fb773b4982e2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2e75714-50ff-4df4-9eb6-403299bc98cf"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:07:34.710541 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-902d89d9-f9c0-446b-8e59-fb773b4982e2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:34.717193 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-902d89d9-f9c0-446b-8e59-fb773b4982e2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:34.717654 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-902d89d9-f9c0-446b-8e59-fb773b4982e2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:34.718417 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-902d89d9-f9c0-446b-8e59-fb773b4982e2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:34.718849 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-902d89d9-f9c0-446b-8e59-fb773b4982e2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:35.001694 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-902d89d9-f9c0-446b-8e59-fb773b4982e2 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "POST /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295945 May 26 14:07:35.002338 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 594/1225] 10.222.0.91 () {60 vars in 1322 bytes} [Thu May 26 14:07:34 2022] POST /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:07:42.604631 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-de0210f1-f0a9-41fc-8110-c293522bc1f4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:42.605237 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-de0210f1-f0a9-41fc-8110-c293522bc1f4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:42.612675 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-de0210f1-f0a9-41fc-8110-c293522bc1f4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:42.613121 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-de0210f1-f0a9-41fc-8110-c293522bc1f4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:42.613913 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-de0210f1-f0a9-41fc-8110-c293522bc1f4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:42.614344 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-de0210f1-f0a9-41fc-8110-c293522bc1f4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:42.696129 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-de0210f1-f0a9-41fc-8110-c293522bc1f4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lazy-loading 'services' on Instance uuid 70afcd8b-ecce-41cf-9d39-8f7484bdb65d {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:07:42.771874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-de0210f1-f0a9-41fc-8110-c293522bc1f4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "DELETE /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d/os-volume_attachments/d2e75714-50ff-4df4-9eb6-403299bc98cf" status: 202 len: 0 microversion: 2.1 time: 0.171405 May 26 14:07:42.772508 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 632/1226] 10.222.0.91 () {58 vars in 1415 bytes} [Thu May 26 14:07:42 2022] DELETE /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d/os-volume_attachments/d2e75714-50ff-4df4-9eb6-403299bc98cf => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:07:42.782820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-024aacd1-52b8-42ee-ab9e-2112cf8fd9f8 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:42.783834 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-024aacd1-52b8-42ee-ab9e-2112cf8fd9f8 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:42.785817 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:07:42.791748 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-024aacd1-52b8-42ee-ab9e-2112cf8fd9f8 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:42.792196 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-024aacd1-52b8-42ee-ab9e-2112cf8fd9f8 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:42.793122 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-024aacd1-52b8-42ee-ab9e-2112cf8fd9f8 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:42.793713 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-024aacd1-52b8-42ee-ab9e-2112cf8fd9f8 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:42.824749 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-024aacd1-52b8-42ee-ab9e-2112cf8fd9f8 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047613 May 26 14:07:42.825839 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 595/1227] 10.222.0.91 () {58 vars in 1301 bytes} [Thu May 26 14:07:42 2022] GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:07:43.838018 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-257073f4-f81c-43b9-bfb1-b061cd64c93a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:43.839164 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-257073f4-f81c-43b9-bfb1-b061cd64c93a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:43.845667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-257073f4-f81c-43b9-bfb1-b061cd64c93a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:43.846120 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-257073f4-f81c-43b9-bfb1-b061cd64c93a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:43.846894 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-257073f4-f81c-43b9-bfb1-b061cd64c93a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:43.847329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-257073f4-f81c-43b9-bfb1-b061cd64c93a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:43.876772 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-257073f4-f81c-43b9-bfb1-b061cd64c93a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043770 May 26 14:07:43.877348 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 633/1228] 10.222.0.91 () {58 vars in 1301 bytes} [Thu May 26 14:07:43 2022] GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 14:07:43.935952 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-eb851e11-d236-475f-adaa-6276ea6bdf4c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:43.936465 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-eb851e11-d236-475f-adaa-6276ea6bdf4c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:43.942965 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eb851e11-d236-475f-adaa-6276ea6bdf4c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:43.943406 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eb851e11-d236-475f-adaa-6276ea6bdf4c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:43.944153 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eb851e11-d236-475f-adaa-6276ea6bdf4c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:43.944586 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eb851e11-d236-475f-adaa-6276ea6bdf4c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:43.969501 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-eb851e11-d236-475f-adaa-6276ea6bdf4c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 14:07:44.044182 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-eb851e11-d236-475f-adaa-6276ea6bdf4c tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "DELETE /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d" status: 204 len: 0 microversion: 2.1 time: 0.112189 May 26 14:07:44.044697 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 596/1229] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 14:07:43 2022] DELETE /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 14:07:44.053747 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e9f6e335-06c5-4d56-9337-a4c62b12c5ee tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:44.054487 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e9f6e335-06c5-4d56-9337-a4c62b12c5ee tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:44.061044 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e9f6e335-06c5-4d56-9337-a4c62b12c5ee tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:44.061523 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e9f6e335-06c5-4d56-9337-a4c62b12c5ee tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:44.062277 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e9f6e335-06c5-4d56-9337-a4c62b12c5ee tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:44.062707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e9f6e335-06c5-4d56-9337-a4c62b12c5ee tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:44.192057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e9f6e335-06c5-4d56-9337-a4c62b12c5ee tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:44.199674 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e9f6e335-06c5-4d56-9337-a4c62b12c5ee tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d" status: 200 len: 1683 microversion: 2.1 time: 0.150035 May 26 14:07:44.200237 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 634/1230] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:44 2022] GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:45.218143 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bf78cf35-40ff-4658-8bb8-65c66fd0c0cd tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:45.218972 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bf78cf35-40ff-4658-8bb8-65c66fd0c0cd tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:45.225428 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bf78cf35-40ff-4658-8bb8-65c66fd0c0cd tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:45.225885 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bf78cf35-40ff-4658-8bb8-65c66fd0c0cd tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:45.226654 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bf78cf35-40ff-4658-8bb8-65c66fd0c0cd tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:45.227098 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bf78cf35-40ff-4658-8bb8-65c66fd0c0cd tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:45.364650 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bf78cf35-40ff-4658-8bb8-65c66fd0c0cd tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:45.373415 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bf78cf35-40ff-4658-8bb8-65c66fd0c0cd tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d" status: 200 len: 1683 microversion: 2.1 time: 0.158916 May 26 14:07:45.374000 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 597/1231] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:45 2022] GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:46.390279 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-46f1bfef-38b4-48f1-b8c0-0675f51bbb8a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:46.390897 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-46f1bfef-38b4-48f1-b8c0-0675f51bbb8a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:46.397620 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-46f1bfef-38b4-48f1-b8c0-0675f51bbb8a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:46.398078 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-46f1bfef-38b4-48f1-b8c0-0675f51bbb8a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:46.398858 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-46f1bfef-38b4-48f1-b8c0-0675f51bbb8a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:46.399299 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-46f1bfef-38b4-48f1-b8c0-0675f51bbb8a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:46.526887 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-46f1bfef-38b4-48f1-b8c0-0675f51bbb8a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:46.534990 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-46f1bfef-38b4-48f1-b8c0-0675f51bbb8a tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d" status: 200 len: 1683 microversion: 2.1 time: 0.148862 May 26 14:07:46.535564 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 635/1232] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:46 2022] GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:47.166675 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-669ca90b-e7b7-424a-b9c5-cc61a040619a req-82edcdcb-0ab4-4f35-93de-05d37093edee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70afcd8b-ecce-41cf-9d39-8f7484bdb65d", "name": "network-vif-deleted", "tag": "197365b1-d8da-490a-8a26-789f87b83be2"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:07:47.176397 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-669ca90b-e7b7-424a-b9c5-cc61a040619a req-82edcdcb-0ab4-4f35-93de-05d37093edee service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:47.176397 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-669ca90b-e7b7-424a-b9c5-cc61a040619a req-82edcdcb-0ab4-4f35-93de-05d37093edee service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:47.188678 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-669ca90b-e7b7-424a-b9c5-cc61a040619a req-82edcdcb-0ab4-4f35-93de-05d37093edee service nova] Creating event network-vif-deleted:197365b1-d8da-490a-8a26-789f87b83be2 for instance 70afcd8b-ecce-41cf-9d39-8f7484bdb65d on hv-cinder-84213 May 26 14:07:47.193467 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-669ca90b-e7b7-424a-b9c5-cc61a040619a req-82edcdcb-0ab4-4f35-93de-05d37093edee service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030451 May 26 14:07:47.198033 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 598/1233] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:07:47.551994 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-894adfdd-3b95-4ed3-af90-bdf0cb77b7b6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:47.552681 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-894adfdd-3b95-4ed3-af90-bdf0cb77b7b6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:47.559194 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-894adfdd-3b95-4ed3-af90-bdf0cb77b7b6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:47.559658 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-894adfdd-3b95-4ed3-af90-bdf0cb77b7b6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:47.561070 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-894adfdd-3b95-4ed3-af90-bdf0cb77b7b6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:47.561531 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-894adfdd-3b95-4ed3-af90-bdf0cb77b7b6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:47.592917 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-894adfdd-3b95-4ed3-af90-bdf0cb77b7b6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:47.593406 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-894adfdd-3b95-4ed3-af90-bdf0cb77b7b6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:47.593879 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-894adfdd-3b95-4ed3-af90-bdf0cb77b7b6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lazy-loading 'fault' on Instance uuid 70afcd8b-ecce-41cf-9d39-8f7484bdb65d {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:07:47.635644 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-894adfdd-3b95-4ed3-af90-bdf0cb77b7b6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592975b43454407abde6c7cab2504982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9d168c40ea4df99b495eb06245d066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:07:47.643488 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-894adfdd-3b95-4ed3-af90-bdf0cb77b7b6 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d" status: 200 len: 1331 microversion: 2.1 time: 0.095495 May 26 14:07:47.644061 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 636/1234] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:47 2022] GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:07:48.661504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0287cfe3-d6ed-4f03-8fba-ff356ab254e0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:48.662203 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0287cfe3-d6ed-4f03-8fba-ff356ab254e0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:48.668426 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0287cfe3-d6ed-4f03-8fba-ff356ab254e0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:48.668877 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0287cfe3-d6ed-4f03-8fba-ff356ab254e0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:48.669679 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0287cfe3-d6ed-4f03-8fba-ff356ab254e0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:48.670115 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0287cfe3-d6ed-4f03-8fba-ff356ab254e0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:48.684720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-0287cfe3-d6ed-4f03-8fba-ff356ab254e0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] HTTP exception thrown: Instance 70afcd8b-ecce-41cf-9d39-8f7484bdb65d could not be found. May 26 14:07:48.686833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0287cfe3-d6ed-4f03-8fba-ff356ab254e0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Request method failure captured: May 26 14:07:48.686833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d HTTP/1.1 May 26 14:07:48.686833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 14:07:48.686833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 14:07:48.686833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 14:07:48.686833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 14:07:48.686833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 14:07:48.686833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 14:07:48.686833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 14:07:48.686833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 14:07:48.686833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4b__678MF1xn-Y-FCgJA6efvs1BUPOjPQR7CX8Syda7vzr5d1CdCh5DI87op5BdIZCVD07V82_W1yg69L4heAf3g2lspOZA26PnKf-_EHlLlY2PFv6bdndxAuwButuA1UEOsadDnC15207Ae7Gdf_dlN6YFnL_d6Ys4jSw91hHf8Ro May 26 14:07:48.686833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 14:07:48.686833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 14:07:48.686833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 14:07:48.686833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 14:07:48.686833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 14:07:48.686833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 14:07:48.686833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:07:48.686833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:48.686833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 14:07:48.686833 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 14:07:48.688446 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_af9d168c40ea4df99b495eb06245d066", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:07:48.688446 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:48.688446 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:07:48.688446 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:48.688446 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:07:48.688446 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 14:07:48.688446 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 14:07:48.688446 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: 592975b43454407abde6c7cab2504982 May 26 14:07:48.688446 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:07:48.688446 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: > May 26 14:07:48.688446 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Instance 70afcd8b-ecce-41cf-9d39-8f7484bdb65d could not be found. May 26 14:07:48.688446 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'id': '70afcd8b-ecce-41cf-9d39-8f7484bdb65d'} May 26 14:07:48.689433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:07:48.689433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:48.689433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:07:48.689433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:07:48.689433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:07:48.689433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:07:48.689433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:07:48.689433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:07:48.689433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:07:48.689433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:07:48.689433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70afcd8b-ecce-41cf-9d39-8f7484bdb65d could not be found. May 26 14:07:48.689433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:07:48.689433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:07:48.689433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:07:48.689433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:48.689433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:07:48.689433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:07:48.689433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:07:48.689433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:07:48.689433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:07:48.690976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:07:48.690976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:07:48.690976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:07:48.690976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:07:48.690976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:07:48.690976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:07:48.690976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:07:48.690976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70afcd8b-ecce-41cf-9d39-8f7484bdb65d could not be found. May 26 14:07:48.690976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:07:48.690976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:07:48.690976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:07:48.690976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:48.690976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:07:48.690976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:07:48.690976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:07:48.690976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:07:48.690976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70afcd8b-ecce-41cf-9d39-8f7484bdb65d could not be found. May 26 14:07:48.690976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:07:48.692441 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0287cfe3-d6ed-4f03-8fba-ff356ab254e0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Returning 404 to user: Instance 70afcd8b-ecce-41cf-9d39-8f7484bdb65d could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:07:48.692441 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0287cfe3-d6ed-4f03-8fba-ff356ab254e0 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d" status: 404 len: 111 microversion: 2.1 time: 0.031519 May 26 14:07:48.692441 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 599/1235] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:48 2022] GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:07:48.697609 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a3b2f8fe-d7fc-495b-b5ec-895457341b42 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '.version_select at 0x7f25a53c7670>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:48.716569 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a3b2f8fe-d7fc-495b-b5ec-895457341b42 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1248733314" status: 202 len: 0 microversion: 2.1 time: 0.022687 May 26 14:07:48.717136 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 637/1236] 10.222.0.91 () {58 vars in 1220 bytes} [Thu May 26 14:07:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1248733314 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:07:50.452188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ae74fbd2-0b13-4a11-af85-2f5065facfec tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:50.452672 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ae74fbd2-0b13-4a11-af85-2f5065facfec tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:50.459112 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ae74fbd2-0b13-4a11-af85-2f5065facfec tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:50.459558 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ae74fbd2-0b13-4a11-af85-2f5065facfec tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:50.460316 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ae74fbd2-0b13-4a11-af85-2f5065facfec tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:50.460750 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ae74fbd2-0b13-4a11-af85-2f5065facfec tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:50.473996 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-ae74fbd2-0b13-4a11-af85-2f5065facfec tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] HTTP exception thrown: Instance 70afcd8b-ecce-41cf-9d39-8f7484bdb65d could not be found. May 26 14:07:50.475528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ae74fbd2-0b13-4a11-af85-2f5065facfec tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Request method failure captured: May 26 14:07:50.475528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: DELETE /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d HTTP/1.1 May 26 14:07:50.475528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 14:07:50.475528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 14:07:50.475528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 14:07:50.475528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 14:07:50.475528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 14:07:50.475528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 14:07:50.475528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 14:07:50.475528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 14:07:50.475528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4b__678MF1xn-Y-FCgJA6efvs1BUPOjPQR7CX8Syda7vzr5d1CdCh5DI87op5BdIZCVD07V82_W1yg69L4heAf3g2lspOZA26PnKf-_EHlLlY2PFv6bdndxAuwButuA1UEOsadDnC15207Ae7Gdf_dlN6YFnL_d6Ys4jSw91hHf8Ro May 26 14:07:50.475528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 14:07:50.475528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 14:07:50.475528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 14:07:50.475528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 14:07:50.475528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 14:07:50.475528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 14:07:50.475528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:07:50.475528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:50.475528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 14:07:50.475528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 14:07:50.477080 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_af9d168c40ea4df99b495eb06245d066", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:07:50.477080 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:50.477080 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:07:50.477080 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:50.477080 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:07:50.477080 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 14:07:50.477080 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 14:07:50.477080 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: 592975b43454407abde6c7cab2504982 May 26 14:07:50.477080 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:07:50.477080 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: > May 26 14:07:50.477080 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Instance 70afcd8b-ecce-41cf-9d39-8f7484bdb65d could not be found. May 26 14:07:50.477080 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'id': '70afcd8b-ecce-41cf-9d39-8f7484bdb65d'} May 26 14:07:50.477991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:07:50.477991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:50.477991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:07:50.477991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:07:50.477991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:07:50.477991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:07:50.477991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:07:50.477991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:07:50.477991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:07:50.477991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:07:50.477991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70afcd8b-ecce-41cf-9d39-8f7484bdb65d could not be found. May 26 14:07:50.477991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:07:50.477991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:07:50.477991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:07:50.477991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:50.477991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:07:50.477991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:07:50.477991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:07:50.477991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:07:50.477991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:07:50.479451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:07:50.479451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 14:07:50.479451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 14:07:50.479451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 14:07:50.479451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 14:07:50.479451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:07:50.479451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:07:50.479451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:07:50.479451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:07:50.479451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70afcd8b-ecce-41cf-9d39-8f7484bdb65d could not be found. May 26 14:07:50.479451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:07:50.479451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:07:50.479451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:07:50.479451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:50.479451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:07:50.479451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:07:50.479451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:07:50.479451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:07:50.479451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70afcd8b-ecce-41cf-9d39-8f7484bdb65d could not be found. May 26 14:07:50.479451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:07:50.480905 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ae74fbd2-0b13-4a11-af85-2f5065facfec tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Returning 404 to user: Instance 70afcd8b-ecce-41cf-9d39-8f7484bdb65d could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:07:50.480905 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ae74fbd2-0b13-4a11-af85-2f5065facfec tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "DELETE /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d" status: 404 len: 111 microversion: 2.1 time: 0.028587 May 26 14:07:50.480905 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 600/1237] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 14:07:50 2022] DELETE /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:07:50.486529 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-56faffda-894e-48a5-b9ad-94d42b573aee tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:50.487137 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-56faffda-894e-48a5-b9ad-94d42b573aee tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 70afcd8b-ecce-41cf-9d39-8f7484bdb65d] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:50.493816 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-56faffda-894e-48a5-b9ad-94d42b573aee tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:50.494270 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-56faffda-894e-48a5-b9ad-94d42b573aee tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:50.495038 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-56faffda-894e-48a5-b9ad-94d42b573aee tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:50.495481 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-56faffda-894e-48a5-b9ad-94d42b573aee tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:50.509006 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-56faffda-894e-48a5-b9ad-94d42b573aee tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] HTTP exception thrown: Instance 70afcd8b-ecce-41cf-9d39-8f7484bdb65d could not be found. May 26 14:07:50.510687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-56faffda-894e-48a5-b9ad-94d42b573aee tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Request method failure captured: May 26 14:07:50.510687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d HTTP/1.1 May 26 14:07:50.510687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 14:07:50.510687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 14:07:50.510687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 14:07:50.510687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 14:07:50.510687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 14:07:50.510687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 14:07:50.510687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 14:07:50.510687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 14:07:50.510687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4b__678MF1xn-Y-FCgJA6efvs1BUPOjPQR7CX8Syda7vzr5d1CdCh5DI87op5BdIZCVD07V82_W1yg69L4heAf3g2lspOZA26PnKf-_EHlLlY2PFv6bdndxAuwButuA1UEOsadDnC15207Ae7Gdf_dlN6YFnL_d6Ys4jSw91hHf8Ro May 26 14:07:50.510687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 14:07:50.510687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 14:07:50.510687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 14:07:50.510687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 14:07:50.510687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 14:07:50.510687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 14:07:50.510687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:07:50.510687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:50.510687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 14:07:50.510687 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 14:07:50.512535 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_af9d168c40ea4df99b495eb06245d066", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:07:50.512535 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:50.512535 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:07:50.512535 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:50.512535 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:07:50.512535 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 14:07:50.512535 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 14:07:50.512535 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: 592975b43454407abde6c7cab2504982 May 26 14:07:50.512535 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:07:50.512535 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 14:07:50.512535 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Instance 70afcd8b-ecce-41cf-9d39-8f7484bdb65d could not be found. May 26 14:07:50.512535 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': '70afcd8b-ecce-41cf-9d39-8f7484bdb65d'} May 26 14:07:50.513645 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:07:50.513645 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:50.513645 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:07:50.513645 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:07:50.513645 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:07:50.513645 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:07:50.513645 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:07:50.513645 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:07:50.513645 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:07:50.513645 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:07:50.513645 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70afcd8b-ecce-41cf-9d39-8f7484bdb65d could not be found. May 26 14:07:50.513645 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:07:50.513645 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:07:50.513645 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:07:50.513645 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:50.513645 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:07:50.513645 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:07:50.513645 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:07:50.513645 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:07:50.513645 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:07:50.515093 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:07:50.515093 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:07:50.515093 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:07:50.515093 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:07:50.515093 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:07:50.515093 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:07:50.515093 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:07:50.515093 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70afcd8b-ecce-41cf-9d39-8f7484bdb65d could not be found. May 26 14:07:50.515093 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:07:50.515093 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:07:50.515093 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:07:50.515093 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:50.515093 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:07:50.515093 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:07:50.515093 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:07:50.515093 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:07:50.515093 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70afcd8b-ecce-41cf-9d39-8f7484bdb65d could not be found. May 26 14:07:50.515093 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:07:50.516745 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-56faffda-894e-48a5-b9ad-94d42b573aee tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Returning 404 to user: Instance 70afcd8b-ecce-41cf-9d39-8f7484bdb65d could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:07:50.516745 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-56faffda-894e-48a5-b9ad-94d42b573aee tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d" status: 404 len: 111 microversion: 2.1 time: 0.030495 May 26 14:07:50.516745 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 638/1238] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:50 2022] GET /compute/v2.1/servers/70afcd8b-ecce-41cf-9d39-8f7484bdb65d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:07:51.648456 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-729fc6da-5376-41c9-a8bb-ecea1bbea5b4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:51.648949 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-729fc6da-5376-41c9-a8bb-ecea1bbea5b4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:51.655870 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-729fc6da-5376-41c9-a8bb-ecea1bbea5b4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:51.656318 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-729fc6da-5376-41c9-a8bb-ecea1bbea5b4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:51.657077 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-729fc6da-5376-41c9-a8bb-ecea1bbea5b4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:51.657541 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-729fc6da-5376-41c9-a8bb-ecea1bbea5b4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:51.670754 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-729fc6da-5376-41c9-a8bb-ecea1bbea5b4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] HTTP exception thrown: Instance d6c7fc24-24aa-48ea-b184-38585d2ffb40 could not be found. May 26 14:07:51.672315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-729fc6da-5376-41c9-a8bb-ecea1bbea5b4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Request method failure captured: May 26 14:07:51.672315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: DELETE /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 HTTP/1.1 May 26 14:07:51.672315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 14:07:51.672315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 14:07:51.672315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 14:07:51.672315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 14:07:51.672315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 14:07:51.672315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 14:07:51.672315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 14:07:51.672315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 14:07:51.672315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4b__678MF1xn-Y-FCgJA6efvs1BUPOjPQR7CX8Syda7vzr5d1CdCh5DI87op5BdIZCVD07V82_W1yg69L4heAf3g2lspOZA26PnKf-_EHlLlY2PFv6bdndxAuwButuA1UEOsadDnC15207Ae7Gdf_dlN6YFnL_d6Ys4jSw91hHf8Ro May 26 14:07:51.672315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 14:07:51.672315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 14:07:51.672315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 14:07:51.672315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 14:07:51.672315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 14:07:51.672315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 14:07:51.672315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:07:51.672315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:51.672315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 14:07:51.672315 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 14:07:51.673918 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_af9d168c40ea4df99b495eb06245d066", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:07:51.673918 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:51.673918 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:07:51.673918 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:51.673918 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:07:51.673918 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 14:07:51.673918 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 14:07:51.673918 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: 592975b43454407abde6c7cab2504982 May 26 14:07:51.673918 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:07:51.673918 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: > May 26 14:07:51.673918 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Instance d6c7fc24-24aa-48ea-b184-38585d2ffb40 could not be found. May 26 14:07:51.673918 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'id': 'd6c7fc24-24aa-48ea-b184-38585d2ffb40'} May 26 14:07:51.674819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:07:51.674819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:51.674819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:07:51.674819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:07:51.674819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:07:51.674819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:07:51.674819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:07:51.674819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:07:51.674819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:07:51.674819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:07:51.674819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6c7fc24-24aa-48ea-b184-38585d2ffb40 could not be found. May 26 14:07:51.674819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:07:51.674819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:07:51.674819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:07:51.674819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:51.674819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:07:51.674819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:07:51.674819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:07:51.674819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:07:51.674819 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:07:51.676285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:07:51.676285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 14:07:51.676285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 14:07:51.676285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 14:07:51.676285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 14:07:51.676285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:07:51.676285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:07:51.676285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:07:51.676285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:07:51.676285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6c7fc24-24aa-48ea-b184-38585d2ffb40 could not be found. May 26 14:07:51.676285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:07:51.676285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:07:51.676285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:07:51.676285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:51.676285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:07:51.676285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:07:51.676285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:07:51.676285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:07:51.676285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6c7fc24-24aa-48ea-b184-38585d2ffb40 could not be found. May 26 14:07:51.676285 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:07:51.677798 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-729fc6da-5376-41c9-a8bb-ecea1bbea5b4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Returning 404 to user: Instance d6c7fc24-24aa-48ea-b184-38585d2ffb40 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:07:51.677798 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-729fc6da-5376-41c9-a8bb-ecea1bbea5b4 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "DELETE /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 404 len: 111 microversion: 2.1 time: 0.029100 May 26 14:07:51.677798 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 601/1239] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 14:07:51 2022] DELETE /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:07:51.682279 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a14fd696-1c11-4fe4-8b93-17d9f3f7c3f5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:51.682888 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a14fd696-1c11-4fe4-8b93-17d9f3f7c3f5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: d6c7fc24-24aa-48ea-b184-38585d2ffb40] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:51.690132 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a14fd696-1c11-4fe4-8b93-17d9f3f7c3f5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:51.690583 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a14fd696-1c11-4fe4-8b93-17d9f3f7c3f5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:51.691351 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a14fd696-1c11-4fe4-8b93-17d9f3f7c3f5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:51.691794 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a14fd696-1c11-4fe4-8b93-17d9f3f7c3f5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:51.705402 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-a14fd696-1c11-4fe4-8b93-17d9f3f7c3f5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] HTTP exception thrown: Instance d6c7fc24-24aa-48ea-b184-38585d2ffb40 could not be found. May 26 14:07:51.706931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a14fd696-1c11-4fe4-8b93-17d9f3f7c3f5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Request method failure captured: May 26 14:07:51.706931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 HTTP/1.1 May 26 14:07:51.706931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 14:07:51.706931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 14:07:51.706931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 14:07:51.706931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 14:07:51.706931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 14:07:51.706931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 14:07:51.706931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 14:07:51.706931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 14:07:51.706931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4b__678MF1xn-Y-FCgJA6efvs1BUPOjPQR7CX8Syda7vzr5d1CdCh5DI87op5BdIZCVD07V82_W1yg69L4heAf3g2lspOZA26PnKf-_EHlLlY2PFv6bdndxAuwButuA1UEOsadDnC15207Ae7Gdf_dlN6YFnL_d6Ys4jSw91hHf8Ro May 26 14:07:51.706931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 14:07:51.706931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 14:07:51.706931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 14:07:51.706931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 14:07:51.706931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 14:07:51.706931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 14:07:51.706931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:07:51.706931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:51.706931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 14:07:51.706931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 14:07:51.708529 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_af9d168c40ea4df99b495eb06245d066", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:07:51.708529 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:51.708529 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:07:51.708529 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:51.708529 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:07:51.708529 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 14:07:51.708529 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 14:07:51.708529 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: 592975b43454407abde6c7cab2504982 May 26 14:07:51.708529 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:07:51.708529 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 14:07:51.708529 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Instance d6c7fc24-24aa-48ea-b184-38585d2ffb40 could not be found. May 26 14:07:51.708529 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': 'd6c7fc24-24aa-48ea-b184-38585d2ffb40'} May 26 14:07:51.709476 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:07:51.709476 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:51.709476 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:07:51.709476 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:07:51.709476 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:07:51.709476 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:07:51.709476 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:07:51.709476 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:07:51.709476 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:07:51.709476 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:07:51.709476 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6c7fc24-24aa-48ea-b184-38585d2ffb40 could not be found. May 26 14:07:51.709476 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:07:51.709476 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:07:51.709476 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:07:51.709476 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:51.709476 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:07:51.709476 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:07:51.709476 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:07:51.709476 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:07:51.709476 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:07:51.710930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:07:51.710930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:07:51.710930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:07:51.710930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:07:51.710930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:07:51.710930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:07:51.710930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:07:51.710930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6c7fc24-24aa-48ea-b184-38585d2ffb40 could not be found. May 26 14:07:51.710930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:07:51.710930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:07:51.710930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:07:51.710930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:51.710930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:07:51.710930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:07:51.710930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:07:51.710930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:07:51.710930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6c7fc24-24aa-48ea-b184-38585d2ffb40 could not be found. May 26 14:07:51.710930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:07:51.712390 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a14fd696-1c11-4fe4-8b93-17d9f3f7c3f5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Returning 404 to user: Instance d6c7fc24-24aa-48ea-b184-38585d2ffb40 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:07:51.712390 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a14fd696-1c11-4fe4-8b93-17d9f3f7c3f5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40" status: 404 len: 111 microversion: 2.1 time: 0.029906 May 26 14:07:51.712390 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 639/1240] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:51 2022] GET /compute/v2.1/servers/d6c7fc24-24aa-48ea-b184-38585d2ffb40 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:07:51.717026 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-de2bbc9a-6d79-4209-82b3-78e793c828d5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:51.717538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-de2bbc9a-6d79-4209-82b3-78e793c828d5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:51.723585 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-de2bbc9a-6d79-4209-82b3-78e793c828d5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:51.724056 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-de2bbc9a-6d79-4209-82b3-78e793c828d5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:51.724808 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-de2bbc9a-6d79-4209-82b3-78e793c828d5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:51.725272 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-de2bbc9a-6d79-4209-82b3-78e793c828d5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:51.738323 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-de2bbc9a-6d79-4209-82b3-78e793c828d5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] HTTP exception thrown: Instance 40c8745d-a394-4026-a5c4-b5ce4c5590e0 could not be found. May 26 14:07:51.739829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-de2bbc9a-6d79-4209-82b3-78e793c828d5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Request method failure captured: May 26 14:07:51.739829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: DELETE /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 HTTP/1.1 May 26 14:07:51.739829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 14:07:51.739829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 14:07:51.739829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 14:07:51.739829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 14:07:51.739829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 14:07:51.739829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 14:07:51.739829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 14:07:51.739829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 14:07:51.739829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4b__678MF1xn-Y-FCgJA6efvs1BUPOjPQR7CX8Syda7vzr5d1CdCh5DI87op5BdIZCVD07V82_W1yg69L4heAf3g2lspOZA26PnKf-_EHlLlY2PFv6bdndxAuwButuA1UEOsadDnC15207Ae7Gdf_dlN6YFnL_d6Ys4jSw91hHf8Ro May 26 14:07:51.739829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 14:07:51.739829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 14:07:51.739829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 14:07:51.739829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 14:07:51.739829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 14:07:51.739829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 14:07:51.739829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:07:51.739829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:51.739829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 14:07:51.739829 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 14:07:51.741519 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_af9d168c40ea4df99b495eb06245d066", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:07:51.741519 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:51.741519 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:07:51.741519 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:51.741519 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:07:51.741519 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 14:07:51.741519 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 14:07:51.741519 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: 592975b43454407abde6c7cab2504982 May 26 14:07:51.741519 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:07:51.741519 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: > May 26 14:07:51.741519 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Instance 40c8745d-a394-4026-a5c4-b5ce4c5590e0 could not be found. May 26 14:07:51.741519 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'id': '40c8745d-a394-4026-a5c4-b5ce4c5590e0'} May 26 14:07:51.742504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:07:51.742504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:51.742504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:07:51.742504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:07:51.742504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:07:51.742504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:07:51.742504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:07:51.742504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:07:51.742504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:07:51.742504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:07:51.742504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40c8745d-a394-4026-a5c4-b5ce4c5590e0 could not be found. May 26 14:07:51.742504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:07:51.742504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:07:51.742504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:07:51.742504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:51.742504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:07:51.742504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:07:51.742504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:07:51.742504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:07:51.742504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:07:51.743980 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:07:51.743980 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 14:07:51.743980 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 14:07:51.743980 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 14:07:51.743980 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 14:07:51.743980 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:07:51.743980 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:07:51.743980 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:07:51.743980 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:07:51.743980 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40c8745d-a394-4026-a5c4-b5ce4c5590e0 could not be found. May 26 14:07:51.743980 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:07:51.743980 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:07:51.743980 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:07:51.743980 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:51.743980 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:07:51.743980 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:07:51.743980 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:07:51.743980 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:07:51.743980 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40c8745d-a394-4026-a5c4-b5ce4c5590e0 could not be found. May 26 14:07:51.743980 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:07:51.745566 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-de2bbc9a-6d79-4209-82b3-78e793c828d5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Returning 404 to user: Instance 40c8745d-a394-4026-a5c4-b5ce4c5590e0 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:07:51.745566 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-de2bbc9a-6d79-4209-82b3-78e793c828d5 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "DELETE /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 404 len: 111 microversion: 2.1 time: 0.028083 May 26 14:07:51.745566 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 602/1241] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 14:07:51 2022] DELETE /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:07:51.749988 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a2fe84ca-834d-45d1-bb07-2319e9d3e355 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:51.750990 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a2fe84ca-834d-45d1-bb07-2319e9d3e355 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 40c8745d-a394-4026-a5c4-b5ce4c5590e0] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:51.756573 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2fe84ca-834d-45d1-bb07-2319e9d3e355 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:51.757032 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2fe84ca-834d-45d1-bb07-2319e9d3e355 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:51.757833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2fe84ca-834d-45d1-bb07-2319e9d3e355 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:51.758279 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2fe84ca-834d-45d1-bb07-2319e9d3e355 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:51.772281 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-a2fe84ca-834d-45d1-bb07-2319e9d3e355 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] HTTP exception thrown: Instance 40c8745d-a394-4026-a5c4-b5ce4c5590e0 could not be found. May 26 14:07:51.773833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a2fe84ca-834d-45d1-bb07-2319e9d3e355 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Request method failure captured: May 26 14:07:51.773833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 HTTP/1.1 May 26 14:07:51.773833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 14:07:51.773833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 14:07:51.773833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 14:07:51.773833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 14:07:51.773833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 14:07:51.773833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 14:07:51.773833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 14:07:51.773833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 14:07:51.773833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4b__678MF1xn-Y-FCgJA6efvs1BUPOjPQR7CX8Syda7vzr5d1CdCh5DI87op5BdIZCVD07V82_W1yg69L4heAf3g2lspOZA26PnKf-_EHlLlY2PFv6bdndxAuwButuA1UEOsadDnC15207Ae7Gdf_dlN6YFnL_d6Ys4jSw91hHf8Ro May 26 14:07:51.773833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 14:07:51.773833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 14:07:51.773833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 14:07:51.773833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 14:07:51.773833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 14:07:51.773833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 14:07:51.773833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:07:51.773833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:51.773833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 14:07:51.773833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 14:07:51.775456 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_af9d168c40ea4df99b495eb06245d066", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:07:51.775456 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:51.775456 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:07:51.775456 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:51.775456 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:07:51.775456 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 14:07:51.775456 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 14:07:51.775456 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: 592975b43454407abde6c7cab2504982 May 26 14:07:51.775456 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:07:51.775456 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 14:07:51.775456 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Instance 40c8745d-a394-4026-a5c4-b5ce4c5590e0 could not be found. May 26 14:07:51.775456 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': '40c8745d-a394-4026-a5c4-b5ce4c5590e0'} May 26 14:07:51.776403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:07:51.776403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:51.776403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:07:51.776403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:07:51.776403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:07:51.776403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:07:51.776403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:07:51.776403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:07:51.776403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:07:51.776403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:07:51.776403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40c8745d-a394-4026-a5c4-b5ce4c5590e0 could not be found. May 26 14:07:51.776403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:07:51.776403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:07:51.776403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:07:51.776403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:51.776403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:07:51.776403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:07:51.776403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:07:51.776403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:07:51.776403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:07:51.777930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:07:51.777930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:07:51.777930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:07:51.777930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:07:51.777930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:07:51.777930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:07:51.777930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:07:51.777930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40c8745d-a394-4026-a5c4-b5ce4c5590e0 could not be found. May 26 14:07:51.777930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:07:51.777930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:07:51.777930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:07:51.777930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:51.777930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:07:51.777930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:07:51.777930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:07:51.777930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:07:51.777930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40c8745d-a394-4026-a5c4-b5ce4c5590e0 could not be found. May 26 14:07:51.777930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:07:51.779389 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a2fe84ca-834d-45d1-bb07-2319e9d3e355 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Returning 404 to user: Instance 40c8745d-a394-4026-a5c4-b5ce4c5590e0 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:07:51.779389 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a2fe84ca-834d-45d1-bb07-2319e9d3e355 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0" status: 404 len: 111 microversion: 2.1 time: 0.029663 May 26 14:07:51.779389 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 640/1242] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:51 2022] GET /compute/v2.1/servers/40c8745d-a394-4026-a5c4-b5ce4c5590e0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:07:52.908075 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5a7171ad-f173-43b1-ad99-da6adadb0696 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:52.908572 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5a7171ad-f173-43b1-ad99-da6adadb0696 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:52.915115 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5a7171ad-f173-43b1-ad99-da6adadb0696 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:52.915556 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5a7171ad-f173-43b1-ad99-da6adadb0696 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:52.916304 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5a7171ad-f173-43b1-ad99-da6adadb0696 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:52.916737 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5a7171ad-f173-43b1-ad99-da6adadb0696 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:52.929855 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-5a7171ad-f173-43b1-ad99-da6adadb0696 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] HTTP exception thrown: Instance 71af8283-a8f5-44e7-bdcd-6606070472b2 could not be found. May 26 14:07:52.931367 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5a7171ad-f173-43b1-ad99-da6adadb0696 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Request method failure captured: May 26 14:07:52.931367 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: DELETE /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 HTTP/1.1 May 26 14:07:52.931367 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 14:07:52.931367 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 14:07:52.931367 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 14:07:52.931367 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 14:07:52.931367 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 14:07:52.931367 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 14:07:52.931367 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 14:07:52.931367 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 14:07:52.931367 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4b__678MF1xn-Y-FCgJA6efvs1BUPOjPQR7CX8Syda7vzr5d1CdCh5DI87op5BdIZCVD07V82_W1yg69L4heAf3g2lspOZA26PnKf-_EHlLlY2PFv6bdndxAuwButuA1UEOsadDnC15207Ae7Gdf_dlN6YFnL_d6Ys4jSw91hHf8Ro May 26 14:07:52.931367 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 14:07:52.931367 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 14:07:52.931367 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 14:07:52.931367 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 14:07:52.931367 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 14:07:52.931367 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 14:07:52.931367 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:07:52.931367 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:52.931367 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 14:07:52.931367 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 14:07:52.932941 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_af9d168c40ea4df99b495eb06245d066", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:07:52.932941 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:52.932941 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:07:52.932941 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:52.932941 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:07:52.932941 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 14:07:52.932941 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 14:07:52.932941 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: 592975b43454407abde6c7cab2504982 May 26 14:07:52.932941 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:07:52.932941 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: > May 26 14:07:52.932941 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Instance 71af8283-a8f5-44e7-bdcd-6606070472b2 could not be found. May 26 14:07:52.932941 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'id': '71af8283-a8f5-44e7-bdcd-6606070472b2'} May 26 14:07:52.936988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:07:52.936988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:52.936988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:07:52.936988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:07:52.936988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:07:52.936988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:07:52.936988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:07:52.936988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:07:52.936988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:07:52.936988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:07:52.936988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71af8283-a8f5-44e7-bdcd-6606070472b2 could not be found. May 26 14:07:52.936988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:07:52.936988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:07:52.936988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:07:52.936988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:52.936988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:07:52.936988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:07:52.936988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:07:52.936988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:07:52.936988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:07:52.938720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:07:52.938720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 14:07:52.938720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 14:07:52.938720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 14:07:52.938720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 14:07:52.938720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:07:52.938720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:07:52.938720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:07:52.938720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:07:52.938720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71af8283-a8f5-44e7-bdcd-6606070472b2 could not be found. May 26 14:07:52.938720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:07:52.938720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:07:52.938720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:07:52.938720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:52.938720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:07:52.938720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:07:52.938720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:07:52.938720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:07:52.938720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71af8283-a8f5-44e7-bdcd-6606070472b2 could not be found. May 26 14:07:52.938720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:07:52.940188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5a7171ad-f173-43b1-ad99-da6adadb0696 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Returning 404 to user: Instance 71af8283-a8f5-44e7-bdcd-6606070472b2 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:07:52.940188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5a7171ad-f173-43b1-ad99-da6adadb0696 tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "DELETE /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 404 len: 111 microversion: 2.1 time: 0.028664 May 26 14:07:52.940188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 603/1243] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 14:07:52 2022] DELETE /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:07:52.941556 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a99b4e6c-499e-4b8a-99a2-8e0f26e4bdda tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:52.942170 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a99b4e6c-499e-4b8a-99a2-8e0f26e4bdda tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] [instance: 71af8283-a8f5-44e7-bdcd-6606070472b2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:07:52.948669 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a99b4e6c-499e-4b8a-99a2-8e0f26e4bdda tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:52.949115 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a99b4e6c-499e-4b8a-99a2-8e0f26e4bdda tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:52.949903 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a99b4e6c-499e-4b8a-99a2-8e0f26e4bdda tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:07:52.950339 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a99b4e6c-499e-4b8a-99a2-8e0f26e4bdda tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:07:52.953552 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:07:52.965682 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-a99b4e6c-499e-4b8a-99a2-8e0f26e4bdda tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] HTTP exception thrown: Instance 71af8283-a8f5-44e7-bdcd-6606070472b2 could not be found. May 26 14:07:52.967231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a99b4e6c-499e-4b8a-99a2-8e0f26e4bdda tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Request method failure captured: May 26 14:07:52.967231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 HTTP/1.1 May 26 14:07:52.967231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 14:07:52.967231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 14:07:52.967231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 14:07:52.967231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 14:07:52.967231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 14:07:52.967231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 14:07:52.967231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 14:07:52.967231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 14:07:52.967231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4b__678MF1xn-Y-FCgJA6efvs1BUPOjPQR7CX8Syda7vzr5d1CdCh5DI87op5BdIZCVD07V82_W1yg69L4heAf3g2lspOZA26PnKf-_EHlLlY2PFv6bdndxAuwButuA1UEOsadDnC15207Ae7Gdf_dlN6YFnL_d6Ys4jSw91hHf8Ro May 26 14:07:52.967231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 14:07:52.967231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 14:07:52.967231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 14:07:52.967231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 14:07:52.967231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 14:07:52.967231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 14:07:52.967231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:07:52.967231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:52.967231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 14:07:52.967231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 14:07:52.968850 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/af9d168c40ea4df99b495eb06245d066"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_af9d168c40ea4df99b495eb06245d066", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:07:52.968850 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:52.968850 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: af9d168c40ea4df99b495eb06245d066 May 26 14:07:52.968850 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1100941131 May 26 14:07:52.968850 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:07:52.968850 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 14:07:52.968850 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 14:07:52.968850 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: 592975b43454407abde6c7cab2504982 May 26 14:07:52.968850 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-1100941131-project May 26 14:07:52.968850 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 14:07:52.968850 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Instance 71af8283-a8f5-44e7-bdcd-6606070472b2 could not be found. May 26 14:07:52.968850 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': '71af8283-a8f5-44e7-bdcd-6606070472b2'} May 26 14:07:52.969930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:07:52.969930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:52.969930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:07:52.969930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:07:52.969930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:07:52.969930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:07:52.969930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:07:52.969930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:07:52.969930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:07:52.969930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:07:52.969930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71af8283-a8f5-44e7-bdcd-6606070472b2 could not be found. May 26 14:07:52.969930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:07:52.969930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:07:52.969930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:07:52.969930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:52.969930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:07:52.969930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:07:52.969930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:07:52.969930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:07:52.969930 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:07:52.971434 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:07:52.971434 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:07:52.971434 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:07:52.971434 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:07:52.971434 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:07:52.971434 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:07:52.971434 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:07:52.971434 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71af8283-a8f5-44e7-bdcd-6606070472b2 could not be found. May 26 14:07:52.971434 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:07:52.971434 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:07:52.971434 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:07:52.971434 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:07:52.971434 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:07:52.971434 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:07:52.971434 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:07:52.971434 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:07:52.971434 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71af8283-a8f5-44e7-bdcd-6606070472b2 could not be found. May 26 14:07:52.971434 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:07:52.972897 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a99b4e6c-499e-4b8a-99a2-8e0f26e4bdda tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] Returning 404 to user: Instance 71af8283-a8f5-44e7-bdcd-6606070472b2 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:07:52.972897 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a99b4e6c-499e-4b8a-99a2-8e0f26e4bdda tempest-AttachVolumeNegativeTest-1100941131 tempest-AttachVolumeNegativeTest-1100941131-project] 10.222.0.91 "GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2" status: 404 len: 111 microversion: 2.1 time: 0.030928 May 26 14:07:52.972897 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 641/1244] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:07:52 2022] GET /compute/v2.1/servers/71af8283-a8f5-44e7-bdcd-6606070472b2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:07:57.522702 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e72876dd-21f5-4565-86a6-4e5b4e7b18d9 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Action: 'create', calling method: .version_select at 0x7f25a9bc91f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-197896523"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:07:57.835294 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e72876dd-21f5-4565-86a6-4e5b4e7b18d9 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.440103 May 26 14:07:57.835959 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 604/1245] 10.222.0.91 () {60 vars in 1154 bytes} [Thu May 26 14:07:57 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 442 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 14:07:57.847190 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ff4c00df-14b7-4eaf-b6ee-5b3152f8bf27 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Calling method '.version_select at 0x7f25a53d2ca0>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:57.896377 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ff4c00df-14b7-4eaf-b6ee-5b3152f8bf27 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/033bf295-f6aa-4b46-848a-19f3b6db2adc" status: 200 len: 344 microversion: 2.1 time: 0.053073 May 26 14:07:57.896962 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 642/1246] 10.222.0.91 () {58 vars in 1244 bytes} [Thu May 26 14:07:57 2022] GET /compute/v2.1/os-volumes/033bf295-f6aa-4b46-848a-19f3b6db2adc => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:07:58.909666 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b5cbbdf3-275a-42ba-8a7d-1c5ccd97ec88 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Calling method '.version_select at 0x7f25a4b27160>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:58.959263 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b5cbbdf3-275a-42ba-8a7d-1c5ccd97ec88 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/033bf295-f6aa-4b46-848a-19f3b6db2adc" status: 200 len: 345 microversion: 2.1 time: 0.053883 May 26 14:07:58.959951 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 605/1247] 10.222.0.91 () {58 vars in 1244 bytes} [Thu May 26 14:07:58 2022] GET /compute/v2.1/os-volumes/033bf295-f6aa-4b46-848a-19f3b6db2adc => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:07:58.971885 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d011824e-1def-40f3-b836-3aa1883ecd6f tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Action: 'create', calling method: .version_select at 0x7f25a53c7700>, body: {"snapshot": {"volume_id": "033bf295-f6aa-4b46-848a-19f3b6db2adc", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-421599817"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:07:59.122027 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d011824e-1def-40f3-b836-3aa1883ecd6f tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] 10.222.0.91 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.154852 May 26 14:07:59.126494 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 643/1248] 10.222.0.91 () {60 vars in 1161 bytes} [Thu May 26 14:07:58 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:07:59.132528 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e2578134-62e7-4245-a5c4-bffd2fcec9aa tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Calling method '.version_select at 0x7f25a9bc94c0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:59.163771 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e2578134-62e7-4245-a5c4-bffd2fcec9aa tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/9999f5a3-8480-425e-9196-d44c609e1681" status: 200 len: 286 microversion: 2.1 time: 0.034944 May 26 14:07:59.164466 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 606/1249] 10.222.0.91 () {58 vars in 1250 bytes} [Thu May 26 14:07:59 2022] GET /compute/v2.1/os-snapshots/9999f5a3-8480-425e-9196-d44c609e1681 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:07:59.175382 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2c82f7b3-2395-4229-a5f4-9d75e5652a54 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Calling method '.version_select at 0x7f25a498a160>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:59.210509 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2c82f7b3-2395-4229-a5f4-9d75e5652a54 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.038996 May 26 14:07:59.211079 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 644/1250] 10.222.0.91 () {58 vars in 1139 bytes} [Thu May 26 14:07:59 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:07:59.221541 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-91361d52-2d78-4381-b317-7c0fa55b8cdc tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Calling method '.version_select at 0x7f25a9bc9310>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:07:59.250843 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-91361d52-2d78-4381-b317-7c0fa55b8cdc tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/9999f5a3-8480-425e-9196-d44c609e1681" status: 200 len: 286 microversion: 2.1 time: 0.033187 May 26 14:07:59.251409 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 607/1251] 10.222.0.91 () {58 vars in 1250 bytes} [Thu May 26 14:07:59 2022] GET /compute/v2.1/os-snapshots/9999f5a3-8480-425e-9196-d44c609e1681 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:08:00.263228 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e35d6753-ee7b-4b5f-b8ed-039d901f2f98 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Calling method '.version_select at 0x7f25a4ba4b80>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:00.292358 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e35d6753-ee7b-4b5f-b8ed-039d901f2f98 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/9999f5a3-8480-425e-9196-d44c609e1681" status: 200 len: 286 microversion: 2.1 time: 0.033638 May 26 14:08:00.292915 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 645/1252] 10.222.0.91 () {58 vars in 1250 bytes} [Thu May 26 14:08:00 2022] GET /compute/v2.1/os-snapshots/9999f5a3-8480-425e-9196-d44c609e1681 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:08:01.304614 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3389cc48-5718-428f-983b-2dc00118ca35 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Calling method '.version_select at 0x7f25a9c43940>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:01.335955 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3389cc48-5718-428f-983b-2dc00118ca35 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/9999f5a3-8480-425e-9196-d44c609e1681" status: 200 len: 286 microversion: 2.1 time: 0.035506 May 26 14:08:01.336526 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 608/1253] 10.222.0.91 () {58 vars in 1250 bytes} [Thu May 26 14:08:01 2022] GET /compute/v2.1/os-snapshots/9999f5a3-8480-425e-9196-d44c609e1681 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:08:02.348879 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6a4583d4-1b97-4617-8165-5d6dd6a06485 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Calling method '.version_select at 0x7f25a5407e50>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:02.377958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6a4583d4-1b97-4617-8165-5d6dd6a06485 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/9999f5a3-8480-425e-9196-d44c609e1681" status: 200 len: 286 microversion: 2.1 time: 0.033354 May 26 14:08:02.378508 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 646/1254] 10.222.0.91 () {58 vars in 1250 bytes} [Thu May 26 14:08:02 2022] GET /compute/v2.1/os-snapshots/9999f5a3-8480-425e-9196-d44c609e1681 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:08:03.387464 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:08:03.388116 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:08:03.392693 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-18b1d0f1-337a-4d61-90df-ef6161239f59 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Calling method '.version_select at 0x7f25a9c43940>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:03.422591 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-18b1d0f1-337a-4d61-90df-ef6161239f59 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/9999f5a3-8480-425e-9196-d44c609e1681" status: 200 len: 286 microversion: 2.1 time: 0.036663 May 26 14:08:03.423142 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 609/1255] 10.222.0.91 () {58 vars in 1250 bytes} [Thu May 26 14:08:03 2022] GET /compute/v2.1/os-snapshots/9999f5a3-8480-425e-9196-d44c609e1681 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:08:04.431332 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:08:04.432195 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:08:04.437342 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7eb557f8-87bc-4be6-948f-fef67380ed94 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Calling method '.version_select at 0x7f25a4ac4a60>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:04.467834 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7eb557f8-87bc-4be6-948f-fef67380ed94 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/9999f5a3-8480-425e-9196-d44c609e1681" status: 200 len: 287 microversion: 2.1 time: 0.037211 May 26 14:08:04.468472 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 647/1256] 10.222.0.91 () {58 vars in 1250 bytes} [Thu May 26 14:08:04 2022] GET /compute/v2.1/os-snapshots/9999f5a3-8480-425e-9196-d44c609e1681 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:08:04.479392 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d1405876-113f-458f-bafd-50048c9853e7 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Calling method '.version_select at 0x7f25a9bc9790>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:04.536836 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d1405876-113f-458f-bafd-50048c9853e7 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] 10.222.0.91 "DELETE /compute/v2.1/os-snapshots/9999f5a3-8480-425e-9196-d44c609e1681" status: 202 len: 0 microversion: 2.1 time: 0.061644 May 26 14:08:04.537560 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 610/1257] 10.222.0.91 () {58 vars in 1253 bytes} [Thu May 26 14:08:04 2022] DELETE /compute/v2.1/os-snapshots/9999f5a3-8480-425e-9196-d44c609e1681 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:08:04.546055 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9b1ded14-632b-44e7-befe-6b0ba8a620a2 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Calling method '.version_select at 0x7f25a4ac4310>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:04.576208 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9b1ded14-632b-44e7-befe-6b0ba8a620a2 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/9999f5a3-8480-425e-9196-d44c609e1681" status: 200 len: 286 microversion: 2.1 time: 0.034341 May 26 14:08:04.576776 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 648/1258] 10.222.0.91 () {58 vars in 1250 bytes} [Thu May 26 14:08:04 2022] GET /compute/v2.1/os-snapshots/9999f5a3-8480-425e-9196-d44c609e1681 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:08:05.588370 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-456b42ab-795c-496e-ad0e-576a07cee0fb tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Calling method '.version_select at 0x7f25a4e4e160>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:05.613043 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-456b42ab-795c-496e-ad0e-576a07cee0fb tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] HTTP exception thrown: Snapshot 9999f5a3-8480-425e-9196-d44c609e1681 could not be found. May 26 14:08:05.615279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-456b42ab-795c-496e-ad0e-576a07cee0fb tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Request method failure captured: May 26 14:08:05.615279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/os-snapshots/9999f5a3-8480-425e-9196-d44c609e1681 HTTP/1.1 May 26 14:08:05.615279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 14:08:05.615279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 14:08:05.615279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 14:08:05.615279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 14:08:05.615279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 14:08:05.615279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 14:08:05.615279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 14:08:05.615279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 14:08:05.615279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4m9msG45Gud9bZc67g1gXTqhU2dPzciCjkuGDEbo5SA0_BJdtlHcWSazEGzV1LbnbH1FKWE8V-7jBRB1s_RZTAEHUt4-ViSrG2CpXSv3SxRRaAUTTLJ6l42-a1gCphU429bs6Hm58v-0FNhDaxw3Gq8rkINS_f5tls2Jz43Swf2gPo May 26 14:08:05.615279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 14:08:05.615279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 14:08:05.615279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 14:08:05.615279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 14:08:05.615279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 14:08:05.615279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 14:08:05.615279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: 478f3f9e176544e092ed2debbe2fe0fb May 26 14:08:05.615279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2024362787 May 26 14:08:05.615279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 14:08:05.615279 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 14:08:05.616869 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/478f3f9e176544e092ed2debbe2fe0fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/478f3f9e176544e092ed2debbe2fe0fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/478f3f9e176544e092ed2debbe2fe0fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_478f3f9e176544e092ed2debbe2fe0fb", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:08:05.616869 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2024362787 May 26 14:08:05.616869 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 478f3f9e176544e092ed2debbe2fe0fb May 26 14:08:05.616869 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2024362787 May 26 14:08:05.616869 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesSnapshotsTestJSON-2024362787-project May 26 14:08:05.616869 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 14:08:05.616869 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 14:08:05.616869 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: c412cb9123c44b248e75df55ae4fb694 May 26 14:08:05.616869 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2024362787-project May 26 14:08:05.616869 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: May 26 14:08:05.616869 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Snapshot 9999f5a3-8480-425e-9196-d44c609e1681 could not be found. May 26 14:08:05.616869 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'id': '9999f5a3-8480-425e-9196-d44c609e1681'} May 26 14:08:05.616869 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:08:05.617824 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:05.617824 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 14:08:05.617824 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 14:08:05.617824 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 14:08:05.617824 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 14:08:05.617824 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 14:08:05.617824 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 14:08:05.617824 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 14:08:05.617824 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 14:08:05.617824 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 14:08:05.617824 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 14:08:05.617824 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 14:08:05.617824 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 14:08:05.617824 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 14:08:05.617824 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 14:08:05.617824 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9999f5a3-8480-425e-9196-d44c609e1681 could not be found. (HTTP 404) (Request-ID: req-26c51210-46b7-4dde-aaab-d390b0773c8c) May 26 14:08:05.617824 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:08:05.617824 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:08:05.619139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:08:05.619139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:05.619139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 26 14:08:05.619139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 26 14:08:05.619139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 14:08:05.619139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 14:08:05.619139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 26 14:08:05.619139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 26 14:08:05.619139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 14:08:05.619139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 14:08:05.619139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 14:08:05.619139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 14:08:05.619139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 14:08:05.619139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 14:08:05.619139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 14:08:05.619139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 14:08:05.619139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 14:08:05.619139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 14:08:05.619139 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 14:08:05.620951 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 14:08:05.620951 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 14:08:05.620951 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 14:08:05.620951 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 14:08:05.620951 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 14:08:05.620951 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9999f5a3-8480-425e-9196-d44c609e1681 could not be found. May 26 14:08:05.620951 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:08:05.620951 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:08:05.620951 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:08:05.620951 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:05.620951 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:08:05.620951 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:08:05.620951 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:08:05.620951 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:08:05.620951 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 14:08:05.620951 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 14:08:05.620951 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:08:05.620951 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:08:05.620951 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 26 14:08:05.620951 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:08:05.623686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9999f5a3-8480-425e-9196-d44c609e1681 could not be found. May 26 14:08:05.623686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:08:05.623686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:08:05.623686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:08:05.623686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:05.623686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:08:05.623686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:08:05.623686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:08:05.623686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:08:05.623686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9999f5a3-8480-425e-9196-d44c609e1681 could not be found. May 26 14:08:05.623686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:08:05.623686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-456b42ab-795c-496e-ad0e-576a07cee0fb tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Returning 404 to user: Snapshot 9999f5a3-8480-425e-9196-d44c609e1681 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:08:05.623686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-456b42ab-795c-496e-ad0e-576a07cee0fb tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/9999f5a3-8480-425e-9196-d44c609e1681" status: 404 len: 111 microversion: 2.1 time: 0.032789 May 26 14:08:05.625332 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 611/1259] 10.222.0.91 () {58 vars in 1250 bytes} [Thu May 26 14:08:05 2022] GET /compute/v2.1/os-snapshots/9999f5a3-8480-425e-9196-d44c609e1681 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:08:05.627411 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-36178b1a-3d45-4cdf-9fab-6cfccfb2cf9c tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Calling method '.version_select at 0x7f25a5407550>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:05.699925 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-36178b1a-3d45-4cdf-9fab-6cfccfb2cf9c tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/033bf295-f6aa-4b46-848a-19f3b6db2adc" status: 202 len: 0 microversion: 2.1 time: 0.077785 May 26 14:08:05.700524 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 649/1260] 10.222.0.91 () {58 vars in 1247 bytes} [Thu May 26 14:08:05 2022] DELETE /compute/v2.1/os-volumes/033bf295-f6aa-4b46-848a-19f3b6db2adc => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:08:05.710291 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-795781a2-2381-4906-9f97-c74e89597bc4 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Calling method '.version_select at 0x7f25a4b275e0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:05.758888 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-795781a2-2381-4906-9f97-c74e89597bc4 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/033bf295-f6aa-4b46-848a-19f3b6db2adc" status: 200 len: 344 microversion: 2.1 time: 0.052342 May 26 14:08:05.759460 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 612/1261] 10.222.0.91 () {58 vars in 1244 bytes} [Thu May 26 14:08:05 2022] GET /compute/v2.1/os-volumes/033bf295-f6aa-4b46-848a-19f3b6db2adc => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:08:06.772423 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3f9b6821-9d21-4b51-87bf-be127400f791 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Calling method '.version_select at 0x7f25a498a280>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:06.807625 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-3f9b6821-9d21-4b51-87bf-be127400f791 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] HTTP exception thrown: Volume 033bf295-f6aa-4b46-848a-19f3b6db2adc could not be found. May 26 14:08:06.809058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3f9b6821-9d21-4b51-87bf-be127400f791 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Request method failure captured: May 26 14:08:06.809058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/os-volumes/033bf295-f6aa-4b46-848a-19f3b6db2adc HTTP/1.1 May 26 14:08:06.809058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 14:08:06.809058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 14:08:06.809058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 14:08:06.809058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 14:08:06.809058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 14:08:06.809058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 14:08:06.809058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 14:08:06.809058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 14:08:06.809058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4m9msG45Gud9bZc67g1gXTqhU2dPzciCjkuGDEbo5SA0_BJdtlHcWSazEGzV1LbnbH1FKWE8V-7jBRB1s_RZTAEHUt4-ViSrG2CpXSv3SxRRaAUTTLJ6l42-a1gCphU429bs6Hm58v-0FNhDaxw3Gq8rkINS_f5tls2Jz43Swf2gPo May 26 14:08:06.809058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 14:08:06.809058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 14:08:06.809058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 14:08:06.809058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 14:08:06.809058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 14:08:06.809058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 14:08:06.809058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: 478f3f9e176544e092ed2debbe2fe0fb May 26 14:08:06.809058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2024362787 May 26 14:08:06.809058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 14:08:06.809058 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 14:08:06.810747 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/478f3f9e176544e092ed2debbe2fe0fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/478f3f9e176544e092ed2debbe2fe0fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/478f3f9e176544e092ed2debbe2fe0fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_478f3f9e176544e092ed2debbe2fe0fb", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:08:06.810747 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2024362787 May 26 14:08:06.810747 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 478f3f9e176544e092ed2debbe2fe0fb May 26 14:08:06.810747 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2024362787 May 26 14:08:06.810747 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-VolumesSnapshotsTestJSON-2024362787-project May 26 14:08:06.810747 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 14:08:06.810747 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 14:08:06.810747 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: c412cb9123c44b248e75df55ae4fb694 May 26 14:08:06.810747 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2024362787-project May 26 14:08:06.810747 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: May 26 14:08:06.810747 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Volume 033bf295-f6aa-4b46-848a-19f3b6db2adc could not be found. May 26 14:08:06.810747 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': '033bf295-f6aa-4b46-848a-19f3b6db2adc'} May 26 14:08:06.810747 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:08:06.811874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:06.811874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 14:08:06.811874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 14:08:06.811874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 14:08:06.811874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 14:08:06.811874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 14:08:06.811874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 14:08:06.811874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 14:08:06.811874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 14:08:06.811874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 14:08:06.811874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 14:08:06.811874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 14:08:06.811874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 14:08:06.811874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 14:08:06.811874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 14:08:06.811874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 033bf295-f6aa-4b46-848a-19f3b6db2adc could not be found. (HTTP 404) (Request-ID: req-f7c6ff88-6a13-47df-8a7f-93df6a3e0619) May 26 14:08:06.811874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:06.811874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:08:06.811874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:06.813329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:06.813329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 14:08:06.813329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 14:08:06.813329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 14:08:06.813329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 14:08:06.813329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 14:08:06.813329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 14:08:06.813329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 14:08:06.813329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 14:08:06.813329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 14:08:06.813329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 14:08:06.813329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 14:08:06.813329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 14:08:06.813329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 14:08:06.813329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 14:08:06.813329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 14:08:06.813329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 14:08:06.813329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 14:08:06.813329 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 14:08:06.814878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 14:08:06.814878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 14:08:06.814878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 14:08:06.814878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 14:08:06.814878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 033bf295-f6aa-4b46-848a-19f3b6db2adc could not be found. May 26 14:08:06.814878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:06.814878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:08:06.814878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:06.814878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:06.814878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:08:06.814878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:08:06.814878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:08:06.814878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:08:06.814878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 14:08:06.814878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 14:08:06.814878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:08:06.814878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:08:06.814878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 14:08:06.814878 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:08:06.816292 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 033bf295-f6aa-4b46-848a-19f3b6db2adc could not be found. May 26 14:08:06.816292 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:06.816292 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:08:06.816292 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:06.816292 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:06.816292 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:08:06.816292 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:08:06.816292 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:08:06.816292 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:08:06.816292 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 033bf295-f6aa-4b46-848a-19f3b6db2adc could not be found. May 26 14:08:06.816292 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:06.816292 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3f9b6821-9d21-4b51-87bf-be127400f791 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Returning 404 to user: Volume 033bf295-f6aa-4b46-848a-19f3b6db2adc could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:08:06.816292 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3f9b6821-9d21-4b51-87bf-be127400f791 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/033bf295-f6aa-4b46-848a-19f3b6db2adc" status: 404 len: 109 microversion: 2.1 time: 0.042458 May 26 14:08:06.816292 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 650/1262] 10.222.0.91 () {58 vars in 1244 bytes} [Thu May 26 14:08:06 2022] GET /compute/v2.1/os-volumes/033bf295-f6aa-4b46-848a-19f3b6db2adc => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:08:06.827181 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3165f93d-cb93-4c88-be9e-7ba2721d9d9d tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Calling method '.version_select at 0x7f25a4998040>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:06.854859 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-3165f93d-cb93-4c88-be9e-7ba2721d9d9d tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] HTTP exception thrown: Volume 033bf295-f6aa-4b46-848a-19f3b6db2adc could not be found. May 26 14:08:06.856822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3165f93d-cb93-4c88-be9e-7ba2721d9d9d tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Request method failure captured: May 26 14:08:06.856822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: DELETE /compute/v2.1/os-volumes/033bf295-f6aa-4b46-848a-19f3b6db2adc HTTP/1.1 May 26 14:08:06.856822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 14:08:06.856822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 14:08:06.856822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 14:08:06.856822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 14:08:06.856822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 14:08:06.856822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 14:08:06.856822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 14:08:06.856822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 14:08:06.856822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4m9msG45Gud9bZc67g1gXTqhU2dPzciCjkuGDEbo5SA0_BJdtlHcWSazEGzV1LbnbH1FKWE8V-7jBRB1s_RZTAEHUt4-ViSrG2CpXSv3SxRRaAUTTLJ6l42-a1gCphU429bs6Hm58v-0FNhDaxw3Gq8rkINS_f5tls2Jz43Swf2gPo May 26 14:08:06.856822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 14:08:06.856822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 14:08:06.856822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 14:08:06.856822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 14:08:06.856822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 14:08:06.856822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 14:08:06.856822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: 478f3f9e176544e092ed2debbe2fe0fb May 26 14:08:06.856822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2024362787 May 26 14:08:06.856822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 14:08:06.856822 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 14:08:06.858684 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/478f3f9e176544e092ed2debbe2fe0fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/478f3f9e176544e092ed2debbe2fe0fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/478f3f9e176544e092ed2debbe2fe0fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_478f3f9e176544e092ed2debbe2fe0fb", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:08:06.858684 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2024362787 May 26 14:08:06.858684 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 478f3f9e176544e092ed2debbe2fe0fb May 26 14:08:06.858684 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2024362787 May 26 14:08:06.858684 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesSnapshotsTestJSON-2024362787-project May 26 14:08:06.858684 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 14:08:06.858684 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 14:08:06.858684 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: c412cb9123c44b248e75df55ae4fb694 May 26 14:08:06.858684 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2024362787-project May 26 14:08:06.858684 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: May 26 14:08:06.858684 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Volume 033bf295-f6aa-4b46-848a-19f3b6db2adc could not be found. May 26 14:08:06.858684 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'id': '033bf295-f6aa-4b46-848a-19f3b6db2adc'} May 26 14:08:06.858684 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:08:06.859675 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:06.859675 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 14:08:06.859675 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 14:08:06.859675 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 14:08:06.859675 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 14:08:06.859675 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 14:08:06.859675 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 14:08:06.859675 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 14:08:06.859675 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 14:08:06.859675 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 14:08:06.859675 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 14:08:06.859675 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 14:08:06.859675 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 14:08:06.859675 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 14:08:06.859675 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 14:08:06.859675 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 033bf295-f6aa-4b46-848a-19f3b6db2adc could not be found. (HTTP 404) (Request-ID: req-0a02bab0-3934-4e5d-8cba-a436654bec38) May 26 14:08:06.859675 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:08:06.859675 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:08:06.859675 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:08:06.861186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:06.861186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 14:08:06.861186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 14:08:06.861186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 14:08:06.861186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 14:08:06.861186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 14:08:06.861186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 14:08:06.861186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 14:08:06.861186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 14:08:06.861186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 14:08:06.861186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 14:08:06.861186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 14:08:06.861186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 14:08:06.861186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 14:08:06.861186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 14:08:06.861186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 14:08:06.861186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 14:08:06.861186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 14:08:06.861186 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 14:08:06.862686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 14:08:06.862686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 14:08:06.862686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 14:08:06.862686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 14:08:06.862686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 033bf295-f6aa-4b46-848a-19f3b6db2adc could not be found. May 26 14:08:06.862686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:08:06.862686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:08:06.862686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:08:06.862686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:06.862686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:08:06.862686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:08:06.862686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:08:06.862686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:08:06.862686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 14:08:06.862686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 14:08:06.862686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:08:06.862686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:08:06.862686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 14:08:06.862686 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:08:06.864292 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 033bf295-f6aa-4b46-848a-19f3b6db2adc could not be found. May 26 14:08:06.864292 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:08:06.864292 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:08:06.864292 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:08:06.864292 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:06.864292 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:08:06.864292 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:08:06.864292 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:08:06.864292 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:08:06.864292 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 033bf295-f6aa-4b46-848a-19f3b6db2adc could not be found. May 26 14:08:06.864292 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:08:06.864292 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3165f93d-cb93-4c88-be9e-7ba2721d9d9d tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Returning 404 to user: Volume 033bf295-f6aa-4b46-848a-19f3b6db2adc could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:08:06.864292 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3165f93d-cb93-4c88-be9e-7ba2721d9d9d tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/033bf295-f6aa-4b46-848a-19f3b6db2adc" status: 404 len: 109 microversion: 2.1 time: 0.037512 May 26 14:08:06.865376 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 613/1263] 10.222.0.91 () {58 vars in 1247 bytes} [Thu May 26 14:08:06 2022] DELETE /compute/v2.1/os-volumes/033bf295-f6aa-4b46-848a-19f3b6db2adc => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:08:06.866710 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1bffe805-3366-4e63-96e5-84603e8808d1 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Calling method '.version_select at 0x7f25a4b7b040>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:06.895966 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-1bffe805-3366-4e63-96e5-84603e8808d1 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] HTTP exception thrown: Volume 033bf295-f6aa-4b46-848a-19f3b6db2adc could not be found. May 26 14:08:06.898047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1bffe805-3366-4e63-96e5-84603e8808d1 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Request method failure captured: May 26 14:08:06.898047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/os-volumes/033bf295-f6aa-4b46-848a-19f3b6db2adc HTTP/1.1 May 26 14:08:06.898047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 14:08:06.898047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 14:08:06.898047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 14:08:06.898047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 14:08:06.898047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 14:08:06.898047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 14:08:06.898047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 14:08:06.898047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 14:08:06.898047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4m9msG45Gud9bZc67g1gXTqhU2dPzciCjkuGDEbo5SA0_BJdtlHcWSazEGzV1LbnbH1FKWE8V-7jBRB1s_RZTAEHUt4-ViSrG2CpXSv3SxRRaAUTTLJ6l42-a1gCphU429bs6Hm58v-0FNhDaxw3Gq8rkINS_f5tls2Jz43Swf2gPo May 26 14:08:06.898047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 14:08:06.898047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 14:08:06.898047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 14:08:06.898047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 14:08:06.898047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 14:08:06.898047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 14:08:06.898047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: 478f3f9e176544e092ed2debbe2fe0fb May 26 14:08:06.898047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2024362787 May 26 14:08:06.898047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 14:08:06.898047 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 14:08:06.899563 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/478f3f9e176544e092ed2debbe2fe0fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/478f3f9e176544e092ed2debbe2fe0fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/478f3f9e176544e092ed2debbe2fe0fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_478f3f9e176544e092ed2debbe2fe0fb", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:08:06.899563 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2024362787 May 26 14:08:06.899563 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 478f3f9e176544e092ed2debbe2fe0fb May 26 14:08:06.899563 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2024362787 May 26 14:08:06.899563 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-VolumesSnapshotsTestJSON-2024362787-project May 26 14:08:06.899563 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 14:08:06.899563 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 14:08:06.899563 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: c412cb9123c44b248e75df55ae4fb694 May 26 14:08:06.899563 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2024362787-project May 26 14:08:06.899563 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: May 26 14:08:06.899563 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Volume 033bf295-f6aa-4b46-848a-19f3b6db2adc could not be found. May 26 14:08:06.899563 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': '033bf295-f6aa-4b46-848a-19f3b6db2adc'} May 26 14:08:06.899563 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:08:06.900425 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:06.900425 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 14:08:06.900425 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 14:08:06.900425 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 14:08:06.900425 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 14:08:06.900425 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 14:08:06.900425 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 14:08:06.900425 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 14:08:06.900425 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 14:08:06.900425 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 14:08:06.900425 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 14:08:06.900425 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 14:08:06.900425 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 14:08:06.900425 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 14:08:06.900425 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 14:08:06.900425 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 033bf295-f6aa-4b46-848a-19f3b6db2adc could not be found. (HTTP 404) (Request-ID: req-5f74a8da-335e-4624-a9e7-25faea9510a2) May 26 14:08:06.900425 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:06.900425 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:08:06.900425 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:06.901837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:06.901837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 14:08:06.901837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 14:08:06.901837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 14:08:06.901837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 14:08:06.901837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 14:08:06.901837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 14:08:06.901837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 14:08:06.901837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 14:08:06.901837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 14:08:06.901837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 14:08:06.901837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 14:08:06.901837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 14:08:06.901837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 14:08:06.901837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 14:08:06.901837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 14:08:06.901837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 14:08:06.901837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 14:08:06.901837 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 14:08:06.903267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 14:08:06.903267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 14:08:06.903267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 14:08:06.903267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 14:08:06.903267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 033bf295-f6aa-4b46-848a-19f3b6db2adc could not be found. May 26 14:08:06.903267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:06.903267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:08:06.903267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:06.903267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:06.903267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:08:06.903267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:08:06.903267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:08:06.903267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:08:06.903267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 14:08:06.903267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 14:08:06.903267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:08:06.903267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:08:06.903267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 14:08:06.903267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:08:06.905407 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 033bf295-f6aa-4b46-848a-19f3b6db2adc could not be found. May 26 14:08:06.905407 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:06.905407 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:08:06.905407 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:06.905407 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:06.905407 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:08:06.905407 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:08:06.905407 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:08:06.905407 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:08:06.905407 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 033bf295-f6aa-4b46-848a-19f3b6db2adc could not be found. May 26 14:08:06.905407 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:06.905407 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1bffe805-3366-4e63-96e5-84603e8808d1 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] Returning 404 to user: Volume 033bf295-f6aa-4b46-848a-19f3b6db2adc could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:08:06.905407 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1bffe805-3366-4e63-96e5-84603e8808d1 tempest-VolumesSnapshotsTestJSON-2024362787 tempest-VolumesSnapshotsTestJSON-2024362787-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/033bf295-f6aa-4b46-848a-19f3b6db2adc" status: 404 len: 109 microversion: 2.1 time: 0.036546 May 26 14:08:06.905407 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 651/1264] 10.222.0.91 () {58 vars in 1244 bytes} [Thu May 26 14:08:06 2022] GET /compute/v2.1/os-volumes/033bf295-f6aa-4b46-848a-19f3b6db2adc => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:08:14.012231 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8dd6fe07-b067-4881-8710-124ab0f1cd89 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:14.013222 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8dd6fe07-b067-4881-8710-124ab0f1cd89 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:14.019849 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8dd6fe07-b067-4881-8710-124ab0f1cd89 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:14.020296 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8dd6fe07-b067-4881-8710-124ab0f1cd89 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:14.021049 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8dd6fe07-b067-4881-8710-124ab0f1cd89 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:14.021507 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8dd6fe07-b067-4881-8710-124ab0f1cd89 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:14.048589 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8dd6fe07-b067-4881-8710-124ab0f1cd89 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041940 May 26 14:08:14.049127 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 614/1265] 10.222.0.91 () {60 vars in 1342 bytes} [Thu May 26 14:08:14 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:08:14.107653 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-88fe1a9c-b9b2-494f-8846-5b11ebff6437 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:14.108244 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-88fe1a9c-b9b2-494f-8846-5b11ebff6437 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:14.114385 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-88fe1a9c-b9b2-494f-8846-5b11ebff6437 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:14.114830 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-88fe1a9c-b9b2-494f-8846-5b11ebff6437 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:14.115592 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-88fe1a9c-b9b2-494f-8846-5b11ebff6437 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:14.116026 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-88fe1a9c-b9b2-494f-8846-5b11ebff6437 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:14.142536 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-88fe1a9c-b9b2-494f-8846-5b11ebff6437 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 14:08:14.219859 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-88fe1a9c-b9b2-494f-8846-5b11ebff6437 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "DELETE /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 204 len: 0 microversion: 2.20 time: 0.116678 May 26 14:08:14.220523 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 652/1266] 10.222.0.91 () {60 vars in 1279 bytes} [Thu May 26 14:08:14 2022] DELETE /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 14:08:14.228718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a727ad5f-e72d-41eb-abfa-022de6b11352 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:14.229368 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a727ad5f-e72d-41eb-abfa-022de6b11352 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:14.235831 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a727ad5f-e72d-41eb-abfa-022de6b11352 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:14.236289 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a727ad5f-e72d-41eb-abfa-022de6b11352 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:14.237052 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a727ad5f-e72d-41eb-abfa-022de6b11352 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:14.237523 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a727ad5f-e72d-41eb-abfa-022de6b11352 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:14.367751 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a727ad5f-e72d-41eb-abfa-022de6b11352 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:14.376745 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a727ad5f-e72d-41eb-abfa-022de6b11352 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:14.378361 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a727ad5f-e72d-41eb-abfa-022de6b11352 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:14.379518 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a727ad5f-e72d-41eb-abfa-022de6b11352 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1720 microversion: 2.20 time: 0.154732 May 26 14:08:14.380088 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 615/1267] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:08:14 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:08:15.399933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-86b9c8ef-3497-4787-b2ef-aa9091e4fb82 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:15.400625 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-86b9c8ef-3497-4787-b2ef-aa9091e4fb82 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:15.407756 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-86b9c8ef-3497-4787-b2ef-aa9091e4fb82 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:15.408204 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-86b9c8ef-3497-4787-b2ef-aa9091e4fb82 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:15.408977 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-86b9c8ef-3497-4787-b2ef-aa9091e4fb82 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:15.409441 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-86b9c8ef-3497-4787-b2ef-aa9091e4fb82 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:15.547758 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-86b9c8ef-3497-4787-b2ef-aa9091e4fb82 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:15.556050 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-86b9c8ef-3497-4787-b2ef-aa9091e4fb82 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:15.557814 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-86b9c8ef-3497-4787-b2ef-aa9091e4fb82 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:15.559062 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-86b9c8ef-3497-4787-b2ef-aa9091e4fb82 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1720 microversion: 2.20 time: 0.163500 May 26 14:08:15.559608 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 653/1268] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:08:15 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:08:16.578099 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b736e882-db99-45c4-9adf-abe03b448b74 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:16.578744 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b736e882-db99-45c4-9adf-abe03b448b74 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:16.585384 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b736e882-db99-45c4-9adf-abe03b448b74 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:16.585827 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b736e882-db99-45c4-9adf-abe03b448b74 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:16.586596 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b736e882-db99-45c4-9adf-abe03b448b74 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:16.587028 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b736e882-db99-45c4-9adf-abe03b448b74 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:16.728148 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b736e882-db99-45c4-9adf-abe03b448b74 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:16.736426 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b736e882-db99-45c4-9adf-abe03b448b74 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:16.738105 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b736e882-db99-45c4-9adf-abe03b448b74 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:16.739320 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b736e882-db99-45c4-9adf-abe03b448b74 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1720 microversion: 2.20 time: 0.165860 May 26 14:08:16.739886 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 616/1269] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:08:16 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:08:17.570940 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-cf4afd68-4ac6-4aa3-92f4-8836ec1d9e1b req-617b8cdf-8044-43d0-8cc6-a4783a938f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7", "name": "network-vif-deleted", "tag": "703563f0-f1dc-4261-919d-1995757e7da5"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:08:17.585950 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-cf4afd68-4ac6-4aa3-92f4-8836ec1d9e1b req-617b8cdf-8044-43d0-8cc6-a4783a938f00 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:17.586480 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-cf4afd68-4ac6-4aa3-92f4-8836ec1d9e1b req-617b8cdf-8044-43d0-8cc6-a4783a938f00 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:17.606282 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-cf4afd68-4ac6-4aa3-92f4-8836ec1d9e1b req-617b8cdf-8044-43d0-8cc6-a4783a938f00 service nova] Creating event network-vif-deleted:703563f0-f1dc-4261-919d-1995757e7da5 for instance 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 on hv-cinder-84213 May 26 14:08:17.614691 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-cf4afd68-4ac6-4aa3-92f4-8836ec1d9e1b req-617b8cdf-8044-43d0-8cc6-a4783a938f00 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047024 May 26 14:08:17.615981 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 654/1270] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:08:17.758416 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-79d2b5d7-406a-4d5a-bf4d-3dcc5e9becf2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:17.759041 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-79d2b5d7-406a-4d5a-bf4d-3dcc5e9becf2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:17.773556 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-79d2b5d7-406a-4d5a-bf4d-3dcc5e9becf2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:17.775477 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-79d2b5d7-406a-4d5a-bf4d-3dcc5e9becf2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:17.776842 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-79d2b5d7-406a-4d5a-bf4d-3dcc5e9becf2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:17.776842 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-79d2b5d7-406a-4d5a-bf4d-3dcc5e9becf2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:17.812245 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-79d2b5d7-406a-4d5a-bf4d-3dcc5e9becf2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:17.812838 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-79d2b5d7-406a-4d5a-bf4d-3dcc5e9becf2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:17.813333 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-79d2b5d7-406a-4d5a-bf4d-3dcc5e9becf2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lazy-loading 'fault' on Instance uuid 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:08:17.853663 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-79d2b5d7-406a-4d5a-bf4d-3dcc5e9becf2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:17.862403 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-79d2b5d7-406a-4d5a-bf4d-3dcc5e9becf2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:17.864120 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-79d2b5d7-406a-4d5a-bf4d-3dcc5e9becf2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c67205b7150c460a81ff545d5ba29cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7116b23d173c4192a6c8d996ad31d57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:17.865135 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-79d2b5d7-406a-4d5a-bf4d-3dcc5e9becf2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 200 len: 1370 microversion: 2.20 time: 0.110702 May 26 14:08:17.865723 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 617/1271] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:08:17 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 1370 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:08:18.883598 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ff560aad-cb16-4795-90db-d966aec96fd1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:18.884306 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ff560aad-cb16-4795-90db-d966aec96fd1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:18.892077 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ff560aad-cb16-4795-90db-d966aec96fd1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:18.892176 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ff560aad-cb16-4795-90db-d966aec96fd1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:18.892869 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ff560aad-cb16-4795-90db-d966aec96fd1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:18.893408 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ff560aad-cb16-4795-90db-d966aec96fd1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:18.907397 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-ff560aad-cb16-4795-90db-d966aec96fd1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] HTTP exception thrown: Instance 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 could not be found. May 26 14:08:18.909003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ff560aad-cb16-4795-90db-d966aec96fd1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Request method failure captured: May 26 14:08:18.909003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 HTTP/1.1 May 26 14:08:18.909003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 14:08:18.909003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 14:08:18.909003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 14:08:18.909003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 14:08:18.909003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 14:08:18.909003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 14:08:18.909003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 14:08:18.909003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 14:08:18.909003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4b73dD-28Z-kviSgN8tUFPMh5TAFeR--fqt6ww-Ip21LiNgjxfZeTR33fuZHIqJ8l73mEQYpiYB16IjIlAY0GhixNdHj73x1gqIuul6-vbrKho1_s_D9hxCOl_hu_VeJsILK7Omb6oKF0NZd2H0lHPKfa2h8pBVd8un4U2-1g34JLU May 26 14:08:18.909003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 14:08:18.909003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 14:08:18.909003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 14:08:18.909003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 14:08:18.909003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Openstack-Nova-Api-Version: 2.20 May 26 14:08:18.909003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 14:08:18.909003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 14:08:18.909003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: 7116b23d173c4192a6c8d996ad31d57c May 26 14:08:18.909003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-460056092 May 26 14:08:18.909003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 14:08:18.909003 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 14:08:18.910749 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/7116b23d173c4192a6c8d996ad31d57c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/7116b23d173c4192a6c8d996ad31d57c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/7116b23d173c4192a6c8d996ad31d57c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_7116b23d173c4192a6c8d996ad31d57c", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:08:18.910749 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeShelveTestJSON-460056092 May 26 14:08:18.910749 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 7116b23d173c4192a6c8d996ad31d57c May 26 14:08:18.910749 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-460056092 May 26 14:08:18.910749 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeShelveTestJSON-460056092-project May 26 14:08:18.910749 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 14:08:18.910749 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 14:08:18.910749 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: c67205b7150c460a81ff545d5ba29cad May 26 14:08:18.910749 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeShelveTestJSON-460056092-project May 26 14:08:18.910749 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 14:08:18.910749 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Instance 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 could not be found. May 26 14:08:18.910749 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': '724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7'} May 26 14:08:18.911768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:08:18.911768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:18.911768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:08:18.911768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:08:18.911768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:08:18.911768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:08:18.911768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:08:18.911768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:08:18.911768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:08:18.911768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:08:18.911768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 could not be found. May 26 14:08:18.911768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:18.911768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:08:18.911768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:18.911768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:18.911768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:08:18.911768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:08:18.911768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:08:18.911768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:08:18.911768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:08:18.913368 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:08:18.913368 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:08:18.913368 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:08:18.913368 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:08:18.913368 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:08:18.913368 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:08:18.913368 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:08:18.913368 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 could not be found. May 26 14:08:18.913368 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:18.913368 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:08:18.913368 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:18.913368 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:18.913368 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:08:18.913368 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:08:18.913368 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:08:18.913368 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:08:18.913368 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 could not be found. May 26 14:08:18.913368 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:18.914750 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ff560aad-cb16-4795-90db-d966aec96fd1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Returning 404 to user: Instance 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:08:18.914750 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ff560aad-cb16-4795-90db-d966aec96fd1 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 404 len: 111 microversion: 2.20 time: 0.031127 May 26 14:08:18.914750 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 655/1272] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:08:18 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 14:08:18.919144 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0e3ad8cb-75ab-4aeb-b3b6-dd9974c79ad0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '.version_select at 0x7f25a4be2a60>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:18.937306 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0e3ad8cb-75ab-4aeb-b3b6-dd9974c79ad0 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-92658048" status: 204 len: 0 microversion: 2.20 time: 0.021847 May 26 14:08:18.937855 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 618/1273] 10.222.0.91 () {60 vars in 1255 bytes} [Thu May 26 14:08:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-92658048 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 14:08:20.718916 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1fcd8aaf-0ce4-4123-8af7-a92c37da118b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:20.719405 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1fcd8aaf-0ce4-4123-8af7-a92c37da118b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:20.725861 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1fcd8aaf-0ce4-4123-8af7-a92c37da118b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:20.726312 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1fcd8aaf-0ce4-4123-8af7-a92c37da118b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:20.727077 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1fcd8aaf-0ce4-4123-8af7-a92c37da118b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:20.727517 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1fcd8aaf-0ce4-4123-8af7-a92c37da118b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:20.741230 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-1fcd8aaf-0ce4-4123-8af7-a92c37da118b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] HTTP exception thrown: Instance 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 could not be found. May 26 14:08:20.742771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1fcd8aaf-0ce4-4123-8af7-a92c37da118b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Request method failure captured: May 26 14:08:20.742771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: DELETE /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 HTTP/1.1 May 26 14:08:20.742771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 14:08:20.742771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 14:08:20.742771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 14:08:20.742771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 14:08:20.742771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 14:08:20.742771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 14:08:20.742771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 14:08:20.742771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 14:08:20.742771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4b73dD-28Z-kviSgN8tUFPMh5TAFeR--fqt6ww-Ip21LiNgjxfZeTR33fuZHIqJ8l73mEQYpiYB16IjIlAY0GhixNdHj73x1gqIuul6-vbrKho1_s_D9hxCOl_hu_VeJsILK7Omb6oKF0NZd2H0lHPKfa2h8pBVd8un4U2-1g34JLU May 26 14:08:20.742771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 14:08:20.742771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 14:08:20.742771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 14:08:20.742771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 14:08:20.742771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Openstack-Nova-Api-Version: 2.20 May 26 14:08:20.742771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 14:08:20.742771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 14:08:20.742771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: 7116b23d173c4192a6c8d996ad31d57c May 26 14:08:20.742771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-460056092 May 26 14:08:20.742771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 14:08:20.742771 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 14:08:20.744613 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/7116b23d173c4192a6c8d996ad31d57c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/7116b23d173c4192a6c8d996ad31d57c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/7116b23d173c4192a6c8d996ad31d57c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_7116b23d173c4192a6c8d996ad31d57c", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:08:20.744613 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeShelveTestJSON-460056092 May 26 14:08:20.744613 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 7116b23d173c4192a6c8d996ad31d57c May 26 14:08:20.744613 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-460056092 May 26 14:08:20.744613 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeShelveTestJSON-460056092-project May 26 14:08:20.744613 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 14:08:20.744613 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 14:08:20.744613 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: c67205b7150c460a81ff545d5ba29cad May 26 14:08:20.744613 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeShelveTestJSON-460056092-project May 26 14:08:20.744613 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 14:08:20.744613 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Instance 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 could not be found. May 26 14:08:20.744613 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': '724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7'} May 26 14:08:20.745667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:08:20.745667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:20.745667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:08:20.745667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:08:20.745667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:08:20.745667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:08:20.745667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:08:20.745667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:08:20.745667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:08:20.745667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:08:20.745667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 could not be found. May 26 14:08:20.745667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:20.745667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:08:20.745667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:20.745667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:20.745667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:08:20.745667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:08:20.745667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:08:20.745667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:08:20.745667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:08:20.747175 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:08:20.747175 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 14:08:20.747175 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 14:08:20.747175 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 14:08:20.747175 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 14:08:20.747175 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:08:20.747175 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:08:20.747175 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:08:20.747175 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:08:20.747175 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 could not be found. May 26 14:08:20.747175 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:20.747175 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:08:20.747175 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:20.747175 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:20.747175 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:08:20.747175 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:08:20.747175 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:08:20.747175 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:08:20.747175 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 could not be found. May 26 14:08:20.747175 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:20.748681 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1fcd8aaf-0ce4-4123-8af7-a92c37da118b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Returning 404 to user: Instance 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:08:20.748681 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1fcd8aaf-0ce4-4123-8af7-a92c37da118b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "DELETE /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 404 len: 111 microversion: 2.20 time: 0.029653 May 26 14:08:20.748681 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 656/1274] 10.222.0.91 () {60 vars in 1279 bytes} [Thu May 26 14:08:20 2022] DELETE /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 14:08:20.752879 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-19d8d52b-2fed-453c-aa85-36976b72ab0b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:20.753525 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-19d8d52b-2fed-453c-aa85-36976b72ab0b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:20.759997 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-19d8d52b-2fed-453c-aa85-36976b72ab0b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:20.760449 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-19d8d52b-2fed-453c-aa85-36976b72ab0b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:20.761239 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-19d8d52b-2fed-453c-aa85-36976b72ab0b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:20.761933 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-19d8d52b-2fed-453c-aa85-36976b72ab0b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:20.774647 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-19d8d52b-2fed-453c-aa85-36976b72ab0b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] HTTP exception thrown: Instance 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 could not be found. May 26 14:08:20.776152 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-19d8d52b-2fed-453c-aa85-36976b72ab0b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Request method failure captured: May 26 14:08:20.776152 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 HTTP/1.1 May 26 14:08:20.776152 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 14:08:20.776152 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 14:08:20.776152 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 14:08:20.776152 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 14:08:20.776152 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 14:08:20.776152 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 14:08:20.776152 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 14:08:20.776152 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 14:08:20.776152 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4b73dD-28Z-kviSgN8tUFPMh5TAFeR--fqt6ww-Ip21LiNgjxfZeTR33fuZHIqJ8l73mEQYpiYB16IjIlAY0GhixNdHj73x1gqIuul6-vbrKho1_s_D9hxCOl_hu_VeJsILK7Omb6oKF0NZd2H0lHPKfa2h8pBVd8un4U2-1g34JLU May 26 14:08:20.776152 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 14:08:20.776152 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 14:08:20.776152 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 14:08:20.776152 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 14:08:20.776152 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Openstack-Nova-Api-Version: 2.20 May 26 14:08:20.776152 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 14:08:20.776152 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 14:08:20.776152 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: 7116b23d173c4192a6c8d996ad31d57c May 26 14:08:20.776152 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-460056092 May 26 14:08:20.776152 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 14:08:20.776152 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 14:08:20.777913 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/7116b23d173c4192a6c8d996ad31d57c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/7116b23d173c4192a6c8d996ad31d57c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/7116b23d173c4192a6c8d996ad31d57c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_7116b23d173c4192a6c8d996ad31d57c", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:08:20.777913 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeShelveTestJSON-460056092 May 26 14:08:20.777913 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 7116b23d173c4192a6c8d996ad31d57c May 26 14:08:20.777913 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-460056092 May 26 14:08:20.777913 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeShelveTestJSON-460056092-project May 26 14:08:20.777913 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 14:08:20.777913 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 14:08:20.777913 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: c67205b7150c460a81ff545d5ba29cad May 26 14:08:20.777913 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeShelveTestJSON-460056092-project May 26 14:08:20.777913 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: > May 26 14:08:20.777913 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Instance 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 could not be found. May 26 14:08:20.777913 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'id': '724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7'} May 26 14:08:20.778931 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:08:20.778931 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:20.778931 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:08:20.778931 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:08:20.778931 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:08:20.778931 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:08:20.778931 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:08:20.778931 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:08:20.778931 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:08:20.778931 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:08:20.778931 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 could not be found. May 26 14:08:20.778931 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:08:20.778931 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:08:20.778931 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:08:20.778931 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:20.778931 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:08:20.778931 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:08:20.778931 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:08:20.778931 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:08:20.778931 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:08:20.780983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:08:20.780983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:08:20.780983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:08:20.780983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:08:20.780983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:08:20.780983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:08:20.780983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:08:20.780983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 could not be found. May 26 14:08:20.780983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:08:20.780983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:08:20.780983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:08:20.780983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:20.780983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:08:20.780983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:08:20.780983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:08:20.780983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:08:20.780983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 could not be found. May 26 14:08:20.780983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:08:20.782478 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-19d8d52b-2fed-453c-aa85-36976b72ab0b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Returning 404 to user: Instance 724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:08:20.782478 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-19d8d52b-2fed-453c-aa85-36976b72ab0b tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7" status: 404 len: 111 microversion: 2.20 time: 0.029045 May 26 14:08:20.782478 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 619/1275] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:08:20 2022] GET /compute/v2.1/servers/724ea51b-cf48-4d4c-ad7d-ac94ea82a5e7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 14:08:21.917997 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a093dc1a-6861-445d-a950-8ea4b3e64382 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:21.918495 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a093dc1a-6861-445d-a950-8ea4b3e64382 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:21.925507 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a093dc1a-6861-445d-a950-8ea4b3e64382 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:21.925958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a093dc1a-6861-445d-a950-8ea4b3e64382 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:21.926723 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a093dc1a-6861-445d-a950-8ea4b3e64382 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:21.927162 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a093dc1a-6861-445d-a950-8ea4b3e64382 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:21.940826 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-a093dc1a-6861-445d-a950-8ea4b3e64382 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] HTTP exception thrown: Instance 9116ee60-50e6-48c5-bcc1-8e9d08e35458 could not be found. May 26 14:08:21.942395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a093dc1a-6861-445d-a950-8ea4b3e64382 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Request method failure captured: May 26 14:08:21.942395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: DELETE /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 HTTP/1.1 May 26 14:08:21.942395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 14:08:21.942395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 14:08:21.942395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 14:08:21.942395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 14:08:21.942395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 14:08:21.942395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 14:08:21.942395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 14:08:21.942395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 14:08:21.942395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4b73dD-28Z-kviSgN8tUFPMh5TAFeR--fqt6ww-Ip21LiNgjxfZeTR33fuZHIqJ8l73mEQYpiYB16IjIlAY0GhixNdHj73x1gqIuul6-vbrKho1_s_D9hxCOl_hu_VeJsILK7Omb6oKF0NZd2H0lHPKfa2h8pBVd8un4U2-1g34JLU May 26 14:08:21.942395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 14:08:21.942395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 14:08:21.942395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 14:08:21.942395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 14:08:21.942395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Openstack-Nova-Api-Version: 2.20 May 26 14:08:21.942395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 14:08:21.942395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 14:08:21.942395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: 7116b23d173c4192a6c8d996ad31d57c May 26 14:08:21.942395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-460056092 May 26 14:08:21.942395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 14:08:21.942395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 14:08:21.944066 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/7116b23d173c4192a6c8d996ad31d57c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/7116b23d173c4192a6c8d996ad31d57c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/7116b23d173c4192a6c8d996ad31d57c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_7116b23d173c4192a6c8d996ad31d57c", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:08:21.944066 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeShelveTestJSON-460056092 May 26 14:08:21.944066 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 7116b23d173c4192a6c8d996ad31d57c May 26 14:08:21.944066 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-460056092 May 26 14:08:21.944066 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeShelveTestJSON-460056092-project May 26 14:08:21.944066 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 14:08:21.944066 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 14:08:21.944066 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: c67205b7150c460a81ff545d5ba29cad May 26 14:08:21.944066 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeShelveTestJSON-460056092-project May 26 14:08:21.944066 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 14:08:21.944066 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Instance 9116ee60-50e6-48c5-bcc1-8e9d08e35458 could not be found. May 26 14:08:21.944066 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': '9116ee60-50e6-48c5-bcc1-8e9d08e35458'} May 26 14:08:21.944938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:08:21.944938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:21.944938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:08:21.944938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:08:21.944938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:08:21.944938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:08:21.944938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:08:21.944938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:08:21.944938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:08:21.944938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:08:21.944938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9116ee60-50e6-48c5-bcc1-8e9d08e35458 could not be found. May 26 14:08:21.944938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:21.944938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:08:21.944938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:21.944938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:21.944938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:08:21.944938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:08:21.944938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:08:21.944938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:08:21.944938 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:08:21.946438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:08:21.946438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 14:08:21.946438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 14:08:21.946438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 14:08:21.946438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 14:08:21.946438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:08:21.946438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:08:21.946438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:08:21.946438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:08:21.946438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9116ee60-50e6-48c5-bcc1-8e9d08e35458 could not be found. May 26 14:08:21.946438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:21.946438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:08:21.946438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:21.946438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:21.946438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:08:21.946438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:08:21.946438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:08:21.946438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:08:21.946438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9116ee60-50e6-48c5-bcc1-8e9d08e35458 could not be found. May 26 14:08:21.946438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:08:21.947955 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a093dc1a-6861-445d-a950-8ea4b3e64382 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Returning 404 to user: Instance 9116ee60-50e6-48c5-bcc1-8e9d08e35458 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:08:21.947955 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a093dc1a-6861-445d-a950-8ea4b3e64382 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "DELETE /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 404 len: 111 microversion: 2.20 time: 0.029628 May 26 14:08:21.947955 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 657/1276] 10.222.0.91 () {60 vars in 1279 bytes} [Thu May 26 14:08:21 2022] DELETE /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 14:08:21.952202 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ab3977a1-bb4b-4f08-8ac5-81866ea9e3e2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:21.952896 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ab3977a1-bb4b-4f08-8ac5-81866ea9e3e2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] [instance: 9116ee60-50e6-48c5-bcc1-8e9d08e35458] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:21.959354 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ab3977a1-bb4b-4f08-8ac5-81866ea9e3e2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:21.959807 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ab3977a1-bb4b-4f08-8ac5-81866ea9e3e2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:21.960571 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ab3977a1-bb4b-4f08-8ac5-81866ea9e3e2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:21.961009 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ab3977a1-bb4b-4f08-8ac5-81866ea9e3e2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:21.974028 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-ab3977a1-bb4b-4f08-8ac5-81866ea9e3e2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] HTTP exception thrown: Instance 9116ee60-50e6-48c5-bcc1-8e9d08e35458 could not be found. May 26 14:08:21.975538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ab3977a1-bb4b-4f08-8ac5-81866ea9e3e2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Request method failure captured: May 26 14:08:21.975538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 HTTP/1.1 May 26 14:08:21.975538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 14:08:21.975538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 14:08:21.975538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 14:08:21.975538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 14:08:21.975538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 14:08:21.975538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 14:08:21.975538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 14:08:21.975538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 14:08:21.975538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4b73dD-28Z-kviSgN8tUFPMh5TAFeR--fqt6ww-Ip21LiNgjxfZeTR33fuZHIqJ8l73mEQYpiYB16IjIlAY0GhixNdHj73x1gqIuul6-vbrKho1_s_D9hxCOl_hu_VeJsILK7Omb6oKF0NZd2H0lHPKfa2h8pBVd8un4U2-1g34JLU May 26 14:08:21.975538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 14:08:21.975538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 14:08:21.975538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 14:08:21.975538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 14:08:21.975538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Openstack-Nova-Api-Version: 2.20 May 26 14:08:21.975538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 14:08:21.975538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 14:08:21.975538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: 7116b23d173c4192a6c8d996ad31d57c May 26 14:08:21.975538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-460056092 May 26 14:08:21.975538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 14:08:21.975538 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 14:08:21.977244 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/7116b23d173c4192a6c8d996ad31d57c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/7116b23d173c4192a6c8d996ad31d57c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/7116b23d173c4192a6c8d996ad31d57c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_7116b23d173c4192a6c8d996ad31d57c", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:08:21.977244 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeShelveTestJSON-460056092 May 26 14:08:21.977244 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 7116b23d173c4192a6c8d996ad31d57c May 26 14:08:21.977244 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-460056092 May 26 14:08:21.977244 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeShelveTestJSON-460056092-project May 26 14:08:21.977244 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 14:08:21.977244 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 14:08:21.977244 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: c67205b7150c460a81ff545d5ba29cad May 26 14:08:21.977244 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeShelveTestJSON-460056092-project May 26 14:08:21.977244 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: > May 26 14:08:21.977244 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Instance 9116ee60-50e6-48c5-bcc1-8e9d08e35458 could not be found. May 26 14:08:21.977244 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'id': '9116ee60-50e6-48c5-bcc1-8e9d08e35458'} May 26 14:08:21.978155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:08:21.978155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:21.978155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:08:21.978155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:08:21.978155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:08:21.978155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:08:21.978155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:08:21.978155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:08:21.978155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:08:21.978155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:08:21.978155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9116ee60-50e6-48c5-bcc1-8e9d08e35458 could not be found. May 26 14:08:21.978155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:08:21.978155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:08:21.978155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:08:21.978155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:21.978155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:08:21.978155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:08:21.978155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:08:21.978155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:08:21.978155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:08:21.979672 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:08:21.979672 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:08:21.979672 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:08:21.979672 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:08:21.979672 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:08:21.979672 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:08:21.979672 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:08:21.979672 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9116ee60-50e6-48c5-bcc1-8e9d08e35458 could not be found. May 26 14:08:21.979672 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:08:21.979672 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:08:21.979672 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:08:21.979672 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:08:21.979672 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:08:21.979672 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:08:21.979672 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:08:21.979672 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:08:21.979672 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9116ee60-50e6-48c5-bcc1-8e9d08e35458 could not be found. May 26 14:08:21.979672 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:08:21.981024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ab3977a1-bb4b-4f08-8ac5-81866ea9e3e2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] Returning 404 to user: Instance 9116ee60-50e6-48c5-bcc1-8e9d08e35458 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:08:21.981024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ab3977a1-bb4b-4f08-8ac5-81866ea9e3e2 tempest-AttachVolumeShelveTestJSON-460056092 tempest-AttachVolumeShelveTestJSON-460056092-project] 10.222.0.91 "GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458" status: 404 len: 111 microversion: 2.20 time: 0.028676 May 26 14:08:21.981024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 620/1277] 10.222.0.91 () {60 vars in 1276 bytes} [Thu May 26 14:08:21 2022] GET /compute/v2.1/servers/9116ee60-50e6-48c5-bcc1-8e9d08e35458 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 14:08:33.658156 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-811df2b2-acb1-432e-a955-9bf1e7f044c0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:33.658720 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-811df2b2-acb1-432e-a955-9bf1e7f044c0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:33.660967 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:08:33.661641 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:08:33.666833 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-811df2b2-acb1-432e-a955-9bf1e7f044c0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:33.667282 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-811df2b2-acb1-432e-a955-9bf1e7f044c0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:33.668057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-811df2b2-acb1-432e-a955-9bf1e7f044c0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:33.668489 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-811df2b2-acb1-432e-a955-9bf1e7f044c0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:33.768301 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-811df2b2-acb1-432e-a955-9bf1e7f044c0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lazy-loading 'services' on Instance uuid 73a8a362-d930-47d5-b449-fec49325ba7a {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:08:33.846838 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-811df2b2-acb1-432e-a955-9bf1e7f044c0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "DELETE /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a/os-volume_attachments/1e1099d7-acf5-4312-bfd3-e5a1e299cbce" status: 202 len: 0 microversion: 2.1 time: 0.193246 May 26 14:08:33.847707 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 658/1278] 10.222.0.91 () {58 vars in 1415 bytes} [Thu May 26 14:08:33 2022] DELETE /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a/os-volume_attachments/1e1099d7-acf5-4312-bfd3-e5a1e299cbce => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:08:36.046504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7451b16f-65d5-4417-9eda-7f35be787246 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:08:36.049762 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:08:36.050606 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=30 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:08:36.057592 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7451b16f-65d5-4417-9eda-7f35be787246 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:36.057592 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7451b16f-65d5-4417-9eda-7f35be787246 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:36.083342 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7451b16f-65d5-4417-9eda-7f35be787246 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Going to try to stop instance {{(pid=117787) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 14:08:36.134563 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7451b16f-65d5-4417-9eda-7f35be787246 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "POST /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a/action" status: 202 len: 0 microversion: 2.1 time: 0.090989 May 26 14:08:36.137258 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 621/1279] 10.222.0.91 () {60 vars in 1277 bytes} [Thu May 26 14:08:36 2022] POST /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:08:36.145609 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-91924915-8f74-4da9-9130-337f8dec1a3b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:36.146922 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-91924915-8f74-4da9-9130-337f8dec1a3b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:36.160021 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-91924915-8f74-4da9-9130-337f8dec1a3b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:36.160480 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-91924915-8f74-4da9-9130-337f8dec1a3b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:36.161286 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-91924915-8f74-4da9-9130-337f8dec1a3b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:36.161719 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-91924915-8f74-4da9-9130-337f8dec1a3b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:36.332245 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-91924915-8f74-4da9-9130-337f8dec1a3b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:36.340984 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-91924915-8f74-4da9-9130-337f8dec1a3b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1676 microversion: 2.1 time: 0.199314 May 26 14:08:36.341227 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 659/1280] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:08:36 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1676 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:08:37.359325 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a98739a2-0f9c-41e3-a29f-2bc6ea09ce2c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:37.360293 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a98739a2-0f9c-41e3-a29f-2bc6ea09ce2c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:37.366965 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a98739a2-0f9c-41e3-a29f-2bc6ea09ce2c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:37.367412 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a98739a2-0f9c-41e3-a29f-2bc6ea09ce2c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:37.368177 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a98739a2-0f9c-41e3-a29f-2bc6ea09ce2c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:37.368612 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a98739a2-0f9c-41e3-a29f-2bc6ea09ce2c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:37.508103 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a98739a2-0f9c-41e3-a29f-2bc6ea09ce2c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:37.516119 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a98739a2-0f9c-41e3-a29f-2bc6ea09ce2c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1676 microversion: 2.1 time: 0.161658 May 26 14:08:37.516707 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 622/1281] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:08:37 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:08:38.534453 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b5e44ade-dfcb-4403-8b29-ba2ff6ffd51a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:38.535063 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b5e44ade-dfcb-4403-8b29-ba2ff6ffd51a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:38.541565 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b5e44ade-dfcb-4403-8b29-ba2ff6ffd51a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:38.542020 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b5e44ade-dfcb-4403-8b29-ba2ff6ffd51a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:38.542800 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b5e44ade-dfcb-4403-8b29-ba2ff6ffd51a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:38.543232 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b5e44ade-dfcb-4403-8b29-ba2ff6ffd51a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:38.714455 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b5e44ade-dfcb-4403-8b29-ba2ff6ffd51a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:38.724532 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b5e44ade-dfcb-4403-8b29-ba2ff6ffd51a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1676 microversion: 2.1 time: 0.193083 May 26 14:08:38.725615 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 660/1282] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:08:38 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1676 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:08:39.743979 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-92aaaa43-5c83-4f20-bed5-43c880d5deac tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:39.744735 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-92aaaa43-5c83-4f20-bed5-43c880d5deac tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:39.754490 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-92aaaa43-5c83-4f20-bed5-43c880d5deac tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:39.755075 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-92aaaa43-5c83-4f20-bed5-43c880d5deac tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:39.755857 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-92aaaa43-5c83-4f20-bed5-43c880d5deac tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:39.756298 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-92aaaa43-5c83-4f20-bed5-43c880d5deac tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:39.891911 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-92aaaa43-5c83-4f20-bed5-43c880d5deac tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:39.900522 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-92aaaa43-5c83-4f20-bed5-43c880d5deac tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1676 microversion: 2.1 time: 0.160420 May 26 14:08:39.901200 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 623/1283] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:08:39 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:08:40.918146 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-996e182e-016b-47fe-a77d-b8d7b2b63ea3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:40.921596 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-996e182e-016b-47fe-a77d-b8d7b2b63ea3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:40.928520 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-996e182e-016b-47fe-a77d-b8d7b2b63ea3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:40.928973 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-996e182e-016b-47fe-a77d-b8d7b2b63ea3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:40.929766 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-996e182e-016b-47fe-a77d-b8d7b2b63ea3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:40.930194 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-996e182e-016b-47fe-a77d-b8d7b2b63ea3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:41.078505 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-996e182e-016b-47fe-a77d-b8d7b2b63ea3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:41.086568 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-996e182e-016b-47fe-a77d-b8d7b2b63ea3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1676 microversion: 2.1 time: 0.172260 May 26 14:08:41.087558 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 661/1284] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:08:40 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:08:42.104083 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-da359d8a-5396-40ac-9ef6-a0092339ad00 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:42.104689 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-da359d8a-5396-40ac-9ef6-a0092339ad00 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:42.112068 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da359d8a-5396-40ac-9ef6-a0092339ad00 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:42.112620 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da359d8a-5396-40ac-9ef6-a0092339ad00 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:42.113627 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da359d8a-5396-40ac-9ef6-a0092339ad00 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:42.114004 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da359d8a-5396-40ac-9ef6-a0092339ad00 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:42.243108 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-da359d8a-5396-40ac-9ef6-a0092339ad00 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:42.251244 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-da359d8a-5396-40ac-9ef6-a0092339ad00 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1676 microversion: 2.1 time: 0.151016 May 26 14:08:42.251803 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 624/1285] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:08:42 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:08:43.268962 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e1658f6a-9005-48fe-bba4-090cd5228017 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:43.269535 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e1658f6a-9005-48fe-bba4-090cd5228017 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:43.276785 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e1658f6a-9005-48fe-bba4-090cd5228017 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:43.277264 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e1658f6a-9005-48fe-bba4-090cd5228017 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:43.278023 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e1658f6a-9005-48fe-bba4-090cd5228017 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:43.278456 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e1658f6a-9005-48fe-bba4-090cd5228017 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:43.404137 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e1658f6a-9005-48fe-bba4-090cd5228017 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:43.411690 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e1658f6a-9005-48fe-bba4-090cd5228017 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1676 microversion: 2.1 time: 0.146691 May 26 14:08:43.412259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 662/1286] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:08:43 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:08:44.430197 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-913b35da-ed9f-484b-9ab6-d7363b9f1c7e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:44.430913 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-913b35da-ed9f-484b-9ab6-d7363b9f1c7e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:44.437873 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-913b35da-ed9f-484b-9ab6-d7363b9f1c7e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:44.438330 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-913b35da-ed9f-484b-9ab6-d7363b9f1c7e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:44.439106 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-913b35da-ed9f-484b-9ab6-d7363b9f1c7e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:44.439582 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-913b35da-ed9f-484b-9ab6-d7363b9f1c7e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:44.589628 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-913b35da-ed9f-484b-9ab6-d7363b9f1c7e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:44.597052 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-913b35da-ed9f-484b-9ab6-d7363b9f1c7e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1676 microversion: 2.1 time: 0.171066 May 26 14:08:44.597589 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 625/1287] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:08:44 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:08:45.614768 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2363cede-afb7-44ca-9e98-2b17d195ab62 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:45.615370 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2363cede-afb7-44ca-9e98-2b17d195ab62 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:45.622005 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2363cede-afb7-44ca-9e98-2b17d195ab62 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:45.622457 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2363cede-afb7-44ca-9e98-2b17d195ab62 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:45.623216 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2363cede-afb7-44ca-9e98-2b17d195ab62 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:45.623652 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2363cede-afb7-44ca-9e98-2b17d195ab62 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:45.749293 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2363cede-afb7-44ca-9e98-2b17d195ab62 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:45.756759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2363cede-afb7-44ca-9e98-2b17d195ab62 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1676 microversion: 2.1 time: 0.145985 May 26 14:08:45.757349 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 663/1288] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:08:45 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:08:46.774480 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ec945271-3cf2-431d-bbce-e92583d61b9a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:46.775122 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ec945271-3cf2-431d-bbce-e92583d61b9a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:46.781782 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ec945271-3cf2-431d-bbce-e92583d61b9a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:46.782180 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ec945271-3cf2-431d-bbce-e92583d61b9a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:46.782944 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ec945271-3cf2-431d-bbce-e92583d61b9a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:46.783383 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ec945271-3cf2-431d-bbce-e92583d61b9a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:46.913328 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ec945271-3cf2-431d-bbce-e92583d61b9a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:46.921310 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ec945271-3cf2-431d-bbce-e92583d61b9a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1676 microversion: 2.1 time: 0.150649 May 26 14:08:46.921880 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 626/1289] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:08:46 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:08:47.938776 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a64eccf5-7d33-4ecf-9240-91984b3c4658 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:47.939379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a64eccf5-7d33-4ecf-9240-91984b3c4658 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:47.945829 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a64eccf5-7d33-4ecf-9240-91984b3c4658 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:47.946273 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a64eccf5-7d33-4ecf-9240-91984b3c4658 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:47.947057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a64eccf5-7d33-4ecf-9240-91984b3c4658 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:47.947486 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a64eccf5-7d33-4ecf-9240-91984b3c4658 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:48.074519 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a64eccf5-7d33-4ecf-9240-91984b3c4658 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:48.081983 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a64eccf5-7d33-4ecf-9240-91984b3c4658 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1676 microversion: 2.1 time: 0.147645 May 26 14:08:48.082550 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 664/1290] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:08:47 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:08:49.098709 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d6f4b274-64b5-4eec-95a5-a9f59683b93d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:49.099502 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d6f4b274-64b5-4eec-95a5-a9f59683b93d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:49.107117 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d6f4b274-64b5-4eec-95a5-a9f59683b93d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:49.107590 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d6f4b274-64b5-4eec-95a5-a9f59683b93d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:49.108356 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d6f4b274-64b5-4eec-95a5-a9f59683b93d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:49.108828 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d6f4b274-64b5-4eec-95a5-a9f59683b93d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:49.243246 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d6f4b274-64b5-4eec-95a5-a9f59683b93d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:49.251178 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d6f4b274-64b5-4eec-95a5-a9f59683b93d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1676 microversion: 2.1 time: 0.156486 May 26 14:08:49.252072 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 627/1291] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:08:49 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:08:50.268580 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-69629b14-1b60-43e4-acd9-fd32e119c2e1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:50.269238 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-69629b14-1b60-43e4-acd9-fd32e119c2e1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:50.276144 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-69629b14-1b60-43e4-acd9-fd32e119c2e1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:50.276666 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-69629b14-1b60-43e4-acd9-fd32e119c2e1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:50.277490 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-69629b14-1b60-43e4-acd9-fd32e119c2e1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:50.277927 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-69629b14-1b60-43e4-acd9-fd32e119c2e1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:50.421194 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-69629b14-1b60-43e4-acd9-fd32e119c2e1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:50.429404 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-69629b14-1b60-43e4-acd9-fd32e119c2e1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1676 microversion: 2.1 time: 0.165019 May 26 14:08:50.430071 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 665/1292] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:08:50 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:08:51.446958 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-88e3e1b4-ae27-4222-9f14-8b5bfb34b4df tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:51.447571 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-88e3e1b4-ae27-4222-9f14-8b5bfb34b4df tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:51.453991 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-88e3e1b4-ae27-4222-9f14-8b5bfb34b4df tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:51.454443 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-88e3e1b4-ae27-4222-9f14-8b5bfb34b4df tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:51.455226 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-88e3e1b4-ae27-4222-9f14-8b5bfb34b4df tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:51.455667 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-88e3e1b4-ae27-4222-9f14-8b5bfb34b4df tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:51.648459 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-88e3e1b4-ae27-4222-9f14-8b5bfb34b4df tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:51.656720 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-88e3e1b4-ae27-4222-9f14-8b5bfb34b4df tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1676 microversion: 2.1 time: 0.213603 May 26 14:08:51.657351 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 628/1293] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:08:51 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1676 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:08:52.674387 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b1dfc2ea-0edf-4875-890c-9e76107f397e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:52.675030 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b1dfc2ea-0edf-4875-890c-9e76107f397e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:52.681415 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b1dfc2ea-0edf-4875-890c-9e76107f397e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:52.681860 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b1dfc2ea-0edf-4875-890c-9e76107f397e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:52.682624 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b1dfc2ea-0edf-4875-890c-9e76107f397e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:52.683057 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b1dfc2ea-0edf-4875-890c-9e76107f397e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:52.831962 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b1dfc2ea-0edf-4875-890c-9e76107f397e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:52.840660 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b1dfc2ea-0edf-4875-890c-9e76107f397e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1653 microversion: 2.1 time: 0.170521 May 26 14:08:52.841274 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 666/1294] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:08:52 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1653 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:08:52.860338 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9b9de272-1dc7-487f-85fb-38433cc4d7e4 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:08:52.867220 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b9de272-1dc7-487f-85fb-38433cc4d7e4 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:52.867683 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b9de272-1dc7-487f-85fb-38433cc4d7e4 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:52.890331 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9b9de272-1dc7-487f-85fb-38433cc4d7e4 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Going to try to start instance {{(pid=117787) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 14:08:52.930587 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9b9de272-1dc7-487f-85fb-38433cc4d7e4 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "POST /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a/action" status: 202 len: 0 microversion: 2.1 time: 0.076236 May 26 14:08:52.931180 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 629/1295] 10.222.0.91 () {60 vars in 1277 bytes} [Thu May 26 14:08:52 2022] POST /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:08:52.939541 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-75ccd448-19bf-418a-9eef-cd3e7195464d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:52.940151 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-75ccd448-19bf-418a-9eef-cd3e7195464d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:52.946133 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-75ccd448-19bf-418a-9eef-cd3e7195464d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:52.946583 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-75ccd448-19bf-418a-9eef-cd3e7195464d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:52.947363 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-75ccd448-19bf-418a-9eef-cd3e7195464d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:52.947794 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-75ccd448-19bf-418a-9eef-cd3e7195464d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:53.076096 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-75ccd448-19bf-418a-9eef-cd3e7195464d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:53.083576 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-75ccd448-19bf-418a-9eef-cd3e7195464d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1662 microversion: 2.1 time: 0.147856 May 26 14:08:53.084151 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 667/1296] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:08:52 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1662 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:08:54.102593 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-aed5b7d9-d7ad-4437-a4d3-ee616247df24 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:54.103291 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-aed5b7d9-d7ad-4437-a4d3-ee616247df24 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:54.110155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aed5b7d9-d7ad-4437-a4d3-ee616247df24 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:54.111120 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aed5b7d9-d7ad-4437-a4d3-ee616247df24 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:54.111565 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aed5b7d9-d7ad-4437-a4d3-ee616247df24 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:54.112024 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aed5b7d9-d7ad-4437-a4d3-ee616247df24 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:54.242774 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-aed5b7d9-d7ad-4437-a4d3-ee616247df24 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:54.250876 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-aed5b7d9-d7ad-4437-a4d3-ee616247df24 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1662 microversion: 2.1 time: 0.153131 May 26 14:08:54.251671 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 630/1297] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:08:54 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1662 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:08:55.269910 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-80bfe980-c1f2-4105-be81-edb0ad1b9728 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:08:55.270695 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-80bfe980-c1f2-4105-be81-edb0ad1b9728 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:08:55.277906 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-80bfe980-c1f2-4105-be81-edb0ad1b9728 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:55.278361 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-80bfe980-c1f2-4105-be81-edb0ad1b9728 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:55.279128 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-80bfe980-c1f2-4105-be81-edb0ad1b9728 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:08:55.279568 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-80bfe980-c1f2-4105-be81-edb0ad1b9728 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:08:55.413552 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-80bfe980-c1f2-4105-be81-edb0ad1b9728 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:08:55.421850 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-80bfe980-c1f2-4105-be81-edb0ad1b9728 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1666 microversion: 2.1 time: 0.155745 May 26 14:08:55.422447 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 668/1298] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:08:55 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1666 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:09:38.471033 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:09:38.471640 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Thu May 26 14:09:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 14:09:45.096690 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f2aaebe1-19da-418e-b789-37188ecdde5e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:09:45.097372 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f2aaebe1-19da-418e-b789-37188ecdde5e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 75f06b3a-5413-4231-9d67-79c5f7f45b62] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:09:45.099464 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=22 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:09:45.099877 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=20 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:09:45.100337 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:09:45.100716 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:09:45.106969 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f2aaebe1-19da-418e-b789-37188ecdde5e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:45.107419 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f2aaebe1-19da-418e-b789-37188ecdde5e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:45.108452 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f2aaebe1-19da-418e-b789-37188ecdde5e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:45.109030 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f2aaebe1-19da-418e-b789-37188ecdde5e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:45.139449 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f2aaebe1-19da-418e-b789-37188ecdde5e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 75f06b3a-5413-4231-9d67-79c5f7f45b62] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 14:09:45.230260 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f2aaebe1-19da-418e-b789-37188ecdde5e tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "DELETE /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62" status: 204 len: 0 microversion: 2.1 time: 0.138041 May 26 14:09:45.231406 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 631/1299] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 14:09:45 2022] DELETE /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 14:09:45.241955 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-daac0f5e-f1e4-4a01-83f3-240458898542 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:09:45.242753 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-daac0f5e-f1e4-4a01-83f3-240458898542 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 75f06b3a-5413-4231-9d67-79c5f7f45b62] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:09:45.250187 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-daac0f5e-f1e4-4a01-83f3-240458898542 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:45.250715 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-daac0f5e-f1e4-4a01-83f3-240458898542 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:45.251733 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-daac0f5e-f1e4-4a01-83f3-240458898542 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:45.252464 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-daac0f5e-f1e4-4a01-83f3-240458898542 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:45.348702 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-7c13747e-fd91-43c9-95bc-8811f81dd8cb req-45b06368-d7a9-41a2-93cd-ae84aa27f843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75f06b3a-5413-4231-9d67-79c5f7f45b62", "tag": "70c52bfb-dbc8-4c34-9c1c-2176592f141a"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:09:45.357220 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-7c13747e-fd91-43c9-95bc-8811f81dd8cb req-45b06368-d7a9-41a2-93cd-ae84aa27f843 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:45.357971 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-7c13747e-fd91-43c9-95bc-8811f81dd8cb req-45b06368-d7a9-41a2-93cd-ae84aa27f843 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:45.369682 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-7c13747e-fd91-43c9-95bc-8811f81dd8cb req-45b06368-d7a9-41a2-93cd-ae84aa27f843 service nova] Creating event network-changed:70c52bfb-dbc8-4c34-9c1c-2176592f141a for instance 75f06b3a-5413-4231-9d67-79c5f7f45b62 on hv-cinder-84213 May 26 14:09:45.375567 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-7c13747e-fd91-43c9-95bc-8811f81dd8cb req-45b06368-d7a9-41a2-93cd-ae84aa27f843 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.280263 May 26 14:09:45.376719 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 669/1300] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:09:45.400906 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-daac0f5e-f1e4-4a01-83f3-240458898542 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:09:45.408645 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-daac0f5e-f1e4-4a01-83f3-240458898542 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62" status: 200 len: 1579 microversion: 2.1 time: 0.172432 May 26 14:09:45.409226 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 632/1301] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:09:45 2022] GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62 => generated 1579 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:09:46.428501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-86ade472-2771-4f8d-a718-e11049471313 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:09:46.429395 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-86ade472-2771-4f8d-a718-e11049471313 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 75f06b3a-5413-4231-9d67-79c5f7f45b62] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:09:46.436068 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-86ade472-2771-4f8d-a718-e11049471313 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:46.436513 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-86ade472-2771-4f8d-a718-e11049471313 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:46.437319 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-86ade472-2771-4f8d-a718-e11049471313 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:46.437755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-86ade472-2771-4f8d-a718-e11049471313 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:46.573686 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-86ade472-2771-4f8d-a718-e11049471313 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:09:46.590683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-86ade472-2771-4f8d-a718-e11049471313 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62" status: 200 len: 1579 microversion: 2.1 time: 0.166970 May 26 14:09:46.591275 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 670/1302] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:09:46 2022] GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62 => generated 1579 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:09:47.609741 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c7d93856-fe56-4c4f-a6ac-b5b4be083274 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:09:47.610776 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c7d93856-fe56-4c4f-a6ac-b5b4be083274 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 75f06b3a-5413-4231-9d67-79c5f7f45b62] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:09:47.618563 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c7d93856-fe56-4c4f-a6ac-b5b4be083274 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:47.619009 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c7d93856-fe56-4c4f-a6ac-b5b4be083274 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:47.619821 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c7d93856-fe56-4c4f-a6ac-b5b4be083274 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:47.620251 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c7d93856-fe56-4c4f-a6ac-b5b4be083274 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:47.755022 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c7d93856-fe56-4c4f-a6ac-b5b4be083274 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:09:47.763216 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c7d93856-fe56-4c4f-a6ac-b5b4be083274 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62" status: 200 len: 1460 microversion: 2.1 time: 0.158951 May 26 14:09:47.763802 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 633/1303] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:09:47 2022] GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62 => generated 1460 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:09:47.855726 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-ea8005d1-22c8-4b5a-b6c5-cd63fdf87b24 req-45fea150-5375-4f33-a054-11d9b4988909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75f06b3a-5413-4231-9d67-79c5f7f45b62", "name": "network-vif-deleted", "tag": "70c52bfb-dbc8-4c34-9c1c-2176592f141a"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:09:47.865080 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-ea8005d1-22c8-4b5a-b6c5-cd63fdf87b24 req-45fea150-5375-4f33-a054-11d9b4988909 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:47.865549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-ea8005d1-22c8-4b5a-b6c5-cd63fdf87b24 req-45fea150-5375-4f33-a054-11d9b4988909 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:47.876615 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-ea8005d1-22c8-4b5a-b6c5-cd63fdf87b24 req-45fea150-5375-4f33-a054-11d9b4988909 service nova] Creating event network-vif-deleted:70c52bfb-dbc8-4c34-9c1c-2176592f141a for instance 75f06b3a-5413-4231-9d67-79c5f7f45b62 on hv-cinder-84213 May 26 14:09:47.881710 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-ea8005d1-22c8-4b5a-b6c5-cd63fdf87b24 req-45fea150-5375-4f33-a054-11d9b4988909 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029611 May 26 14:09:47.882267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 671/1304] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:09:48.780137 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dd72fcc3-76f3-4a7c-b1c1-51acd88b5cd8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:09:48.780775 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-dd72fcc3-76f3-4a7c-b1c1-51acd88b5cd8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 75f06b3a-5413-4231-9d67-79c5f7f45b62] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:09:48.787240 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dd72fcc3-76f3-4a7c-b1c1-51acd88b5cd8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:48.787691 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dd72fcc3-76f3-4a7c-b1c1-51acd88b5cd8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:48.788447 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dd72fcc3-76f3-4a7c-b1c1-51acd88b5cd8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:48.788884 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dd72fcc3-76f3-4a7c-b1c1-51acd88b5cd8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:48.819141 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dd72fcc3-76f3-4a7c-b1c1-51acd88b5cd8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:48.819584 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dd72fcc3-76f3-4a7c-b1c1-51acd88b5cd8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:48.820027 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-dd72fcc3-76f3-4a7c-b1c1-51acd88b5cd8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lazy-loading 'fault' on Instance uuid 75f06b3a-5413-4231-9d67-79c5f7f45b62 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:09:48.859470 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dd72fcc3-76f3-4a7c-b1c1-51acd88b5cd8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:09:48.866879 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dd72fcc3-76f3-4a7c-b1c1-51acd88b5cd8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62" status: 200 len: 1230 microversion: 2.1 time: 0.090588 May 26 14:09:48.867441 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 634/1305] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:09:48 2022] GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62 => generated 1230 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:09:49.886562 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3e7c55c5-d891-435c-91b0-dedaa26ca624 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:09:49.887251 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3e7c55c5-d891-435c-91b0-dedaa26ca624 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 75f06b3a-5413-4231-9d67-79c5f7f45b62] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:09:49.894133 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e7c55c5-d891-435c-91b0-dedaa26ca624 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:49.894583 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e7c55c5-d891-435c-91b0-dedaa26ca624 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:49.895341 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e7c55c5-d891-435c-91b0-dedaa26ca624 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:49.895774 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e7c55c5-d891-435c-91b0-dedaa26ca624 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:49.911606 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-3e7c55c5-d891-435c-91b0-dedaa26ca624 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] HTTP exception thrown: Instance 75f06b3a-5413-4231-9d67-79c5f7f45b62 could not be found. May 26 14:09:49.913501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3e7c55c5-d891-435c-91b0-dedaa26ca624 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Request method failure captured: May 26 14:09:49.913501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62 HTTP/1.1 May 26 14:09:49.913501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 14:09:49.913501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 14:09:49.913501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 14:09:49.913501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 14:09:49.913501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 14:09:49.913501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 14:09:49.913501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 14:09:49.913501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 14:09:49.913501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4fQEMorT2ibWX8DnqTCd00KeH3g2Pvquv96fAcwf52AY4-8QDs9eEXQntJ4WS1usPhd7zMTjmNb8C5wSbIe0llpMQRt0GQtvObIQk2nSYK7EaP78sjQCzcOWlqlnC54UR_-Woky_khat3-5OxmdrQRD-dheNUsLdYAjZNcC-V6W5Fk May 26 14:09:49.913501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 14:09:49.913501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 14:09:49.913501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 14:09:49.913501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 14:09:49.913501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 14:09:49.913501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 14:09:49.913501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: ed15631acafd41528b96f2ed12c19e5b May 26 14:09:49.913501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-TestVolumeBootPattern-1658933058 May 26 14:09:49.913501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 14:09:49.913501 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 14:09:49.915330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ed15631acafd41528b96f2ed12c19e5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ed15631acafd41528b96f2ed12c19e5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/ed15631acafd41528b96f2ed12c19e5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_ed15631acafd41528b96f2ed12c19e5b", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:09:49.915330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-TestVolumeBootPattern-1658933058 May 26 14:09:49.915330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: ed15631acafd41528b96f2ed12c19e5b May 26 14:09:49.915330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-TestVolumeBootPattern-1658933058 May 26 14:09:49.915330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-TestVolumeBootPattern-1658933058-project May 26 14:09:49.915330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 14:09:49.915330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 14:09:49.915330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: 5068f06b1a8e47b88ba3294169545aa3 May 26 14:09:49.915330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-TestVolumeBootPattern-1658933058-project May 26 14:09:49.915330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 14:09:49.915330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Instance 75f06b3a-5413-4231-9d67-79c5f7f45b62 could not be found. May 26 14:09:49.915330 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': '75f06b3a-5413-4231-9d67-79c5f7f45b62'} May 26 14:09:49.916218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:09:49.916218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:09:49.916218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:09:49.916218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:09:49.916218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:09:49.916218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:09:49.916218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:09:49.916218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:09:49.916218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:09:49.916218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:09:49.916218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75f06b3a-5413-4231-9d67-79c5f7f45b62 could not be found. May 26 14:09:49.916218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:09:49.916218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:09:49.916218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:09:49.916218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:09:49.916218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:09:49.916218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:09:49.916218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:09:49.916218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:09:49.916218 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:09:49.917683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:09:49.917683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:09:49.917683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:09:49.917683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:09:49.917683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:09:49.917683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:09:49.917683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:09:49.917683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75f06b3a-5413-4231-9d67-79c5f7f45b62 could not be found. May 26 14:09:49.917683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:09:49.917683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:09:49.917683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:09:49.917683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:09:49.917683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:09:49.917683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:09:49.917683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:09:49.917683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:09:49.917683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75f06b3a-5413-4231-9d67-79c5f7f45b62 could not be found. May 26 14:09:49.917683 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:09:49.918891 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3e7c55c5-d891-435c-91b0-dedaa26ca624 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Returning 404 to user: Instance 75f06b3a-5413-4231-9d67-79c5f7f45b62 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:09:49.918891 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3e7c55c5-d891-435c-91b0-dedaa26ca624 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62" status: 404 len: 111 microversion: 2.1 time: 0.033389 May 26 14:09:49.918891 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 672/1306] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:09:49 2022] GET /compute/v2.1/servers/75f06b3a-5413-4231-9d67-79c5f7f45b62 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:09:52.958146 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-7367ebdb-3a1c-421c-bdb2-08c545cb128c req-a0427806-1392-48cb-99ef-af8437390d51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e68d6609-e48d-4d4d-8327-48fbf40b6ebd", "tag": "caf319b9-9a28-4413-9e5b-84e2d576651e"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:09:52.964429 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d540349b-6361-456d-97be-d57f0e535df2 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:09:52.965074 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d540349b-6361-456d-97be-d57f0e535df2 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: e68d6609-e48d-4d4d-8327-48fbf40b6ebd] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:09:52.966917 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-7367ebdb-3a1c-421c-bdb2-08c545cb128c req-a0427806-1392-48cb-99ef-af8437390d51 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:52.967368 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-7367ebdb-3a1c-421c-bdb2-08c545cb128c req-a0427806-1392-48cb-99ef-af8437390d51 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:52.971551 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d540349b-6361-456d-97be-d57f0e535df2 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:52.972002 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d540349b-6361-456d-97be-d57f0e535df2 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:52.973017 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d540349b-6361-456d-97be-d57f0e535df2 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:52.973497 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d540349b-6361-456d-97be-d57f0e535df2 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:52.979760 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-7367ebdb-3a1c-421c-bdb2-08c545cb128c req-a0427806-1392-48cb-99ef-af8437390d51 service nova] Creating event network-changed:caf319b9-9a28-4413-9e5b-84e2d576651e for instance e68d6609-e48d-4d4d-8327-48fbf40b6ebd on hv-cinder-84213 May 26 14:09:52.985473 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-7367ebdb-3a1c-421c-bdb2-08c545cb128c req-a0427806-1392-48cb-99ef-af8437390d51 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030777 May 26 14:09:52.986074 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 673/1307] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:09:52.999145 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d540349b-6361-456d-97be-d57f0e535df2 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: e68d6609-e48d-4d4d-8327-48fbf40b6ebd] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 14:09:53.091484 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d540349b-6361-456d-97be-d57f0e535df2 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "DELETE /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd" status: 204 len: 0 microversion: 2.1 time: 0.140995 May 26 14:09:53.095988 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 635/1308] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 14:09:52 2022] DELETE /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 14:09:53.107772 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f5135e15-bf2d-4c01-b06a-ec94fecbf5b7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:09:53.108487 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f5135e15-bf2d-4c01-b06a-ec94fecbf5b7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: e68d6609-e48d-4d4d-8327-48fbf40b6ebd] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:09:53.118050 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f5135e15-bf2d-4c01-b06a-ec94fecbf5b7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:53.118502 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f5135e15-bf2d-4c01-b06a-ec94fecbf5b7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:53.119530 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f5135e15-bf2d-4c01-b06a-ec94fecbf5b7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:53.120078 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f5135e15-bf2d-4c01-b06a-ec94fecbf5b7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:53.271753 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f5135e15-bf2d-4c01-b06a-ec94fecbf5b7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:09:53.281593 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f5135e15-bf2d-4c01-b06a-ec94fecbf5b7 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd" status: 200 len: 1577 microversion: 2.1 time: 0.183675 May 26 14:09:53.282464 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 674/1309] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:09:53 2022] GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:09:54.300342 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-72ae15a4-efcf-4b5b-84a3-58adcd0acdbc tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:09:54.301037 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-72ae15a4-efcf-4b5b-84a3-58adcd0acdbc tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: e68d6609-e48d-4d4d-8327-48fbf40b6ebd] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:09:54.307522 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-72ae15a4-efcf-4b5b-84a3-58adcd0acdbc tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:54.307972 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-72ae15a4-efcf-4b5b-84a3-58adcd0acdbc tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:54.308739 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-72ae15a4-efcf-4b5b-84a3-58adcd0acdbc tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:54.309185 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-72ae15a4-efcf-4b5b-84a3-58adcd0acdbc tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:54.448341 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-72ae15a4-efcf-4b5b-84a3-58adcd0acdbc tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5068f06b1a8e47b88ba3294169545aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15631acafd41528b96f2ed12c19e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:09:54.460866 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-72ae15a4-efcf-4b5b-84a3-58adcd0acdbc tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd" status: 200 len: 1458 microversion: 2.1 time: 0.164710 May 26 14:09:54.463446 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 636/1310] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:09:54 2022] GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd => generated 1458 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:09:54.500108 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-97551e8e-a429-4d55-885d-4176d04d542c req-1d625e94-8287-4313-a265-e7cf09cec4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e68d6609-e48d-4d4d-8327-48fbf40b6ebd", "name": "network-vif-deleted", "tag": "caf319b9-9a28-4413-9e5b-84e2d576651e"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:09:54.511427 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-97551e8e-a429-4d55-885d-4176d04d542c req-1d625e94-8287-4313-a265-e7cf09cec4f9 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:54.511868 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-97551e8e-a429-4d55-885d-4176d04d542c req-1d625e94-8287-4313-a265-e7cf09cec4f9 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:54.524727 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-97551e8e-a429-4d55-885d-4176d04d542c req-1d625e94-8287-4313-a265-e7cf09cec4f9 service nova] Creating event network-vif-deleted:caf319b9-9a28-4413-9e5b-84e2d576651e for instance e68d6609-e48d-4d4d-8327-48fbf40b6ebd on hv-cinder-84213 May 26 14:09:54.529891 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-97551e8e-a429-4d55-885d-4176d04d542c req-1d625e94-8287-4313-a265-e7cf09cec4f9 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034594 May 26 14:09:54.530514 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 675/1311] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:09:55.478031 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7858de25-353a-497a-9be9-8ae8696abcf8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:09:55.478650 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7858de25-353a-497a-9be9-8ae8696abcf8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: e68d6609-e48d-4d4d-8327-48fbf40b6ebd] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:09:55.485089 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7858de25-353a-497a-9be9-8ae8696abcf8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:55.485555 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7858de25-353a-497a-9be9-8ae8696abcf8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:55.486305 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7858de25-353a-497a-9be9-8ae8696abcf8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:55.486734 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7858de25-353a-497a-9be9-8ae8696abcf8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:55.499581 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-7858de25-353a-497a-9be9-8ae8696abcf8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] HTTP exception thrown: Instance e68d6609-e48d-4d4d-8327-48fbf40b6ebd could not be found. May 26 14:09:55.501206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7858de25-353a-497a-9be9-8ae8696abcf8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Request method failure captured: May 26 14:09:55.501206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd HTTP/1.1 May 26 14:09:55.501206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 14:09:55.501206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 14:09:55.501206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 14:09:55.501206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 14:09:55.501206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 14:09:55.501206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 14:09:55.501206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 14:09:55.501206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 14:09:55.501206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4fQEMorT2ibWX8DnqTCd00KeH3g2Pvquv96fAcwf52AY4-8QDs9eEXQntJ4WS1usPhd7zMTjmNb8C5wSbIe0llpMQRt0GQtvObIQk2nSYK7EaP78sjQCzcOWlqlnC54UR_-Woky_khat3-5OxmdrQRD-dheNUsLdYAjZNcC-V6W5Fk May 26 14:09:55.501206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 14:09:55.501206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 14:09:55.501206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 14:09:55.501206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 14:09:55.501206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 14:09:55.501206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 14:09:55.501206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: ed15631acafd41528b96f2ed12c19e5b May 26 14:09:55.501206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-TestVolumeBootPattern-1658933058 May 26 14:09:55.501206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 14:09:55.501206 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 14:09:55.502881 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ed15631acafd41528b96f2ed12c19e5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ed15631acafd41528b96f2ed12c19e5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/ed15631acafd41528b96f2ed12c19e5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_ed15631acafd41528b96f2ed12c19e5b", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:09:55.502881 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-TestVolumeBootPattern-1658933058 May 26 14:09:55.502881 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: ed15631acafd41528b96f2ed12c19e5b May 26 14:09:55.502881 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-TestVolumeBootPattern-1658933058 May 26 14:09:55.502881 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-TestVolumeBootPattern-1658933058-project May 26 14:09:55.502881 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 14:09:55.502881 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 14:09:55.502881 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: 5068f06b1a8e47b88ba3294169545aa3 May 26 14:09:55.502881 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-TestVolumeBootPattern-1658933058-project May 26 14:09:55.502881 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: > May 26 14:09:55.502881 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Instance e68d6609-e48d-4d4d-8327-48fbf40b6ebd could not be found. May 26 14:09:55.502881 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'id': 'e68d6609-e48d-4d4d-8327-48fbf40b6ebd'} May 26 14:09:55.503983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:09:55.503983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:09:55.503983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:09:55.503983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:09:55.503983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:09:55.503983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:09:55.503983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:09:55.503983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:09:55.503983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:09:55.503983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:09:55.503983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e68d6609-e48d-4d4d-8327-48fbf40b6ebd could not be found. May 26 14:09:55.503983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:09:55.503983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:09:55.503983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:09:55.503983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:09:55.503983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:09:55.503983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:09:55.503983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:09:55.503983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:09:55.503983 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:09:55.505609 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:09:55.505609 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:09:55.505609 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:09:55.505609 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:09:55.505609 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:09:55.505609 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:09:55.505609 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:09:55.505609 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e68d6609-e48d-4d4d-8327-48fbf40b6ebd could not be found. May 26 14:09:55.505609 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:09:55.505609 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:09:55.505609 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:09:55.505609 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:09:55.505609 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:09:55.505609 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:09:55.505609 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:09:55.505609 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:09:55.505609 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e68d6609-e48d-4d4d-8327-48fbf40b6ebd could not be found. May 26 14:09:55.505609 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:09:55.507188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7858de25-353a-497a-9be9-8ae8696abcf8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Returning 404 to user: Instance e68d6609-e48d-4d4d-8327-48fbf40b6ebd could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:09:55.507188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7858de25-353a-497a-9be9-8ae8696abcf8 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd" status: 404 len: 111 microversion: 2.1 time: 0.028411 May 26 14:09:55.507188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 637/1312] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:09:55 2022] GET /compute/v2.1/servers/e68d6609-e48d-4d4d-8327-48fbf40b6ebd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:09:55.935316 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f241ed2d-4efb-4b40-81e1-2ef178ba2aba tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:09:55.935911 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f241ed2d-4efb-4b40-81e1-2ef178ba2aba tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:09:55.943362 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f241ed2d-4efb-4b40-81e1-2ef178ba2aba tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:55.943812 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f241ed2d-4efb-4b40-81e1-2ef178ba2aba tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:55.944590 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f241ed2d-4efb-4b40-81e1-2ef178ba2aba tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:55.945031 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f241ed2d-4efb-4b40-81e1-2ef178ba2aba tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:55.958931 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-f241ed2d-4efb-4b40-81e1-2ef178ba2aba tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] HTTP exception thrown: Instance 5f3aab00-646f-43d0-bc2c-e376b20d7eed could not be found. May 26 14:09:55.960633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f241ed2d-4efb-4b40-81e1-2ef178ba2aba tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Request method failure captured: May 26 14:09:55.960633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: DELETE /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed HTTP/1.1 May 26 14:09:55.960633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 14:09:55.960633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 14:09:55.960633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 14:09:55.960633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 14:09:55.960633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 14:09:55.960633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 14:09:55.960633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 14:09:55.960633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 14:09:55.960633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4fQEMorT2ibWX8DnqTCd00KeH3g2Pvquv96fAcwf52AY4-8QDs9eEXQntJ4WS1usPhd7zMTjmNb8C5wSbIe0llpMQRt0GQtvObIQk2nSYK7EaP78sjQCzcOWlqlnC54UR_-Woky_khat3-5OxmdrQRD-dheNUsLdYAjZNcC-V6W5Fk May 26 14:09:55.960633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 14:09:55.960633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 14:09:55.960633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 14:09:55.960633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 14:09:55.960633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 14:09:55.960633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 14:09:55.960633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: ed15631acafd41528b96f2ed12c19e5b May 26 14:09:55.960633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-TestVolumeBootPattern-1658933058 May 26 14:09:55.960633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 14:09:55.960633 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 14:09:55.962323 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ed15631acafd41528b96f2ed12c19e5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ed15631acafd41528b96f2ed12c19e5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/ed15631acafd41528b96f2ed12c19e5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_ed15631acafd41528b96f2ed12c19e5b", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:09:55.962323 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-TestVolumeBootPattern-1658933058 May 26 14:09:55.962323 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: ed15631acafd41528b96f2ed12c19e5b May 26 14:09:55.962323 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-TestVolumeBootPattern-1658933058 May 26 14:09:55.962323 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-TestVolumeBootPattern-1658933058-project May 26 14:09:55.962323 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 14:09:55.962323 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 14:09:55.962323 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: 5068f06b1a8e47b88ba3294169545aa3 May 26 14:09:55.962323 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-TestVolumeBootPattern-1658933058-project May 26 14:09:55.962323 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 14:09:55.962323 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Instance 5f3aab00-646f-43d0-bc2c-e376b20d7eed could not be found. May 26 14:09:55.962323 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': '5f3aab00-646f-43d0-bc2c-e376b20d7eed'} May 26 14:09:55.963259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:09:55.963259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:09:55.963259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:09:55.963259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:09:55.963259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:09:55.963259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:09:55.963259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:09:55.963259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:09:55.963259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:09:55.963259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:09:55.963259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f3aab00-646f-43d0-bc2c-e376b20d7eed could not be found. May 26 14:09:55.963259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:09:55.963259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:09:55.963259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:09:55.963259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:09:55.963259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:09:55.963259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:09:55.963259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:09:55.963259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:09:55.963259 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:09:55.964759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:09:55.964759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 14:09:55.964759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 14:09:55.964759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 14:09:55.964759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 14:09:55.964759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:09:55.964759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:09:55.964759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:09:55.964759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:09:55.964759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f3aab00-646f-43d0-bc2c-e376b20d7eed could not be found. May 26 14:09:55.964759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:09:55.964759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:09:55.964759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:09:55.964759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:09:55.964759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:09:55.964759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:09:55.964759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:09:55.964759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:09:55.964759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f3aab00-646f-43d0-bc2c-e376b20d7eed could not be found. May 26 14:09:55.964759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:09:55.966254 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f241ed2d-4efb-4b40-81e1-2ef178ba2aba tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Returning 404 to user: Instance 5f3aab00-646f-43d0-bc2c-e376b20d7eed could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:09:55.966254 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f241ed2d-4efb-4b40-81e1-2ef178ba2aba tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "DELETE /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 404 len: 111 microversion: 2.1 time: 0.030999 May 26 14:09:55.966254 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 676/1313] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 14:09:55 2022] DELETE /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:09:55.970868 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-eaa74092-e2e4-402a-a355-9e6121607840 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:09:55.971482 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-eaa74092-e2e4-402a-a355-9e6121607840 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] [instance: 5f3aab00-646f-43d0-bc2c-e376b20d7eed] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:09:55.977452 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eaa74092-e2e4-402a-a355-9e6121607840 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:55.977895 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eaa74092-e2e4-402a-a355-9e6121607840 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:55.978642 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eaa74092-e2e4-402a-a355-9e6121607840 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:09:55.979116 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eaa74092-e2e4-402a-a355-9e6121607840 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:09:55.995160 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-eaa74092-e2e4-402a-a355-9e6121607840 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] HTTP exception thrown: Instance 5f3aab00-646f-43d0-bc2c-e376b20d7eed could not be found. May 26 14:09:55.996718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-eaa74092-e2e4-402a-a355-9e6121607840 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Request method failure captured: May 26 14:09:55.996718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed HTTP/1.1 May 26 14:09:55.996718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 14:09:55.996718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 14:09:55.996718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 14:09:55.996718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 14:09:55.996718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 14:09:55.996718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 14:09:55.996718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 14:09:55.996718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 14:09:55.996718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4fQEMorT2ibWX8DnqTCd00KeH3g2Pvquv96fAcwf52AY4-8QDs9eEXQntJ4WS1usPhd7zMTjmNb8C5wSbIe0llpMQRt0GQtvObIQk2nSYK7EaP78sjQCzcOWlqlnC54UR_-Woky_khat3-5OxmdrQRD-dheNUsLdYAjZNcC-V6W5Fk May 26 14:09:55.996718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 14:09:55.996718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 14:09:55.996718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 14:09:55.996718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 14:09:55.996718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 14:09:55.996718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 14:09:55.996718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: ed15631acafd41528b96f2ed12c19e5b May 26 14:09:55.996718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-TestVolumeBootPattern-1658933058 May 26 14:09:55.996718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 14:09:55.996718 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 14:09:55.998455 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ed15631acafd41528b96f2ed12c19e5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/ed15631acafd41528b96f2ed12c19e5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/ed15631acafd41528b96f2ed12c19e5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_ed15631acafd41528b96f2ed12c19e5b", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:09:55.998455 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-TestVolumeBootPattern-1658933058 May 26 14:09:55.998455 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: ed15631acafd41528b96f2ed12c19e5b May 26 14:09:55.998455 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-TestVolumeBootPattern-1658933058 May 26 14:09:55.998455 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-TestVolumeBootPattern-1658933058-project May 26 14:09:55.998455 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 14:09:55.998455 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 14:09:55.998455 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: 5068f06b1a8e47b88ba3294169545aa3 May 26 14:09:55.998455 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-TestVolumeBootPattern-1658933058-project May 26 14:09:55.998455 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: > May 26 14:09:55.998455 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Instance 5f3aab00-646f-43d0-bc2c-e376b20d7eed could not be found. May 26 14:09:55.998455 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'id': '5f3aab00-646f-43d0-bc2c-e376b20d7eed'} May 26 14:09:55.999768 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:09:55.999768 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:09:55.999768 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:09:55.999768 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:09:55.999768 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:09:55.999768 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:09:55.999768 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:09:55.999768 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:09:55.999768 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:09:55.999768 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:09:55.999768 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f3aab00-646f-43d0-bc2c-e376b20d7eed could not be found. May 26 14:09:55.999768 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:09:55.999768 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:09:55.999768 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:09:55.999768 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:09:55.999768 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:09:55.999768 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:09:55.999768 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:09:55.999768 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:09:55.999768 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:09:56.001055 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:09:56.001055 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:09:56.001055 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:09:56.001055 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:09:56.001055 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:09:56.001055 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:09:56.001055 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:09:56.001055 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f3aab00-646f-43d0-bc2c-e376b20d7eed could not be found. May 26 14:09:56.001055 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:09:56.001055 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:09:56.001055 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:09:56.001055 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:09:56.001055 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:09:56.001055 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:09:56.001055 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:09:56.001055 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:09:56.001055 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f3aab00-646f-43d0-bc2c-e376b20d7eed could not be found. May 26 14:09:56.001055 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:09:56.002246 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-eaa74092-e2e4-402a-a355-9e6121607840 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Returning 404 to user: Instance 5f3aab00-646f-43d0-bc2c-e376b20d7eed could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:09:56.002246 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-eaa74092-e2e4-402a-a355-9e6121607840 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed" status: 404 len: 111 microversion: 2.1 time: 0.031079 May 26 14:09:56.002246 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 638/1314] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:09:55 2022] GET /compute/v2.1/servers/5f3aab00-646f-43d0-bc2c-e376b20d7eed => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:09:57.303887 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c7b9c0ba-481c-42dd-8da0-456cdd43de10 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] Calling method '.version_select at 0x7f25a53c71f0>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:09:57.322895 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c7b9c0ba-481c-42dd-8da0-456cdd43de10 tempest-TestVolumeBootPattern-1658933058 tempest-TestVolumeBootPattern-1658933058-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-886850747" status: 202 len: 0 microversion: 2.1 time: 0.023473 May 26 14:09:57.323469 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 677/1315] 10.222.0.91 () {58 vars in 1259 bytes} [Thu May 26 14:09:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-886850747 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:10:00.808540 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-639c4dc7-e714-42d9-9e05-514c40e21bc7 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:10:00.809619 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-639c4dc7-e714-42d9-9e05-514c40e21bc7 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:10:00.816687 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-639c4dc7-e714-42d9-9e05-514c40e21bc7 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:00.817132 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-639c4dc7-e714-42d9-9e05-514c40e21bc7 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:00.817919 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-639c4dc7-e714-42d9-9e05-514c40e21bc7 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:00.818349 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-639c4dc7-e714-42d9-9e05-514c40e21bc7 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:00.846303 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-639c4dc7-e714-42d9-9e05-514c40e21bc7 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041584 May 26 14:10:00.847038 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 639/1316] 10.222.0.91 () {58 vars in 1301 bytes} [Thu May 26 14:10:00 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 14:10:00.907072 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0a7d9161-6589-48a7-9b43-4b46092fc148 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:10:00.907599 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0a7d9161-6589-48a7-9b43-4b46092fc148 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:10:00.914379 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0a7d9161-6589-48a7-9b43-4b46092fc148 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:00.914827 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0a7d9161-6589-48a7-9b43-4b46092fc148 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:00.915598 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0a7d9161-6589-48a7-9b43-4b46092fc148 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:00.916029 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0a7d9161-6589-48a7-9b43-4b46092fc148 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:00.941934 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0a7d9161-6589-48a7-9b43-4b46092fc148 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 14:10:01.020491 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0a7d9161-6589-48a7-9b43-4b46092fc148 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "DELETE /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 204 len: 0 microversion: 2.1 time: 0.117745 May 26 14:10:01.021348 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 678/1317] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 14:10:00 2022] DELETE /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 14:10:01.029863 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c6156eb3-d187-40bb-99e2-3e7c9e8ac02c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:10:01.031120 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c6156eb3-d187-40bb-99e2-3e7c9e8ac02c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:10:01.037012 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c6156eb3-d187-40bb-99e2-3e7c9e8ac02c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:01.037531 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c6156eb3-d187-40bb-99e2-3e7c9e8ac02c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:01.038288 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c6156eb3-d187-40bb-99e2-3e7c9e8ac02c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:01.038943 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c6156eb3-d187-40bb-99e2-3e7c9e8ac02c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:01.178529 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c6156eb3-d187-40bb-99e2-3e7c9e8ac02c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:10:01.186223 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c6156eb3-d187-40bb-99e2-3e7c9e8ac02c tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1672 microversion: 2.1 time: 0.160174 May 26 14:10:01.187666 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 640/1318] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:10:01 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:10:02.207983 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5bb51b52-5435-466d-ad52-911d353ad95d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:10:02.208702 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5bb51b52-5435-466d-ad52-911d353ad95d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:10:02.215543 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5bb51b52-5435-466d-ad52-911d353ad95d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:02.215997 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5bb51b52-5435-466d-ad52-911d353ad95d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:02.217256 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5bb51b52-5435-466d-ad52-911d353ad95d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:02.217753 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5bb51b52-5435-466d-ad52-911d353ad95d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:02.374378 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5bb51b52-5435-466d-ad52-911d353ad95d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:10:02.386963 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5bb51b52-5435-466d-ad52-911d353ad95d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1672 microversion: 2.1 time: 0.183220 May 26 14:10:02.388159 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 679/1319] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:10:02 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1672 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:10:03.574163 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d84bed45-3c91-4e18-8c2f-685324d007a0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:10:03.581022 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d84bed45-3c91-4e18-8c2f-685324d007a0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:10:03.588996 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d84bed45-3c91-4e18-8c2f-685324d007a0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:03.589770 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d84bed45-3c91-4e18-8c2f-685324d007a0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:03.591017 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d84bed45-3c91-4e18-8c2f-685324d007a0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:03.591587 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d84bed45-3c91-4e18-8c2f-685324d007a0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:03.776908 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d84bed45-3c91-4e18-8c2f-685324d007a0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:10:03.791438 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d84bed45-3c91-4e18-8c2f-685324d007a0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1672 microversion: 2.1 time: 0.389268 May 26 14:10:03.792503 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 641/1320] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:10:03 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1672 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:10:04.528343 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-56c57a3d-8d60-4b27-b2b7-8333fdd05fd0 req-ba7512db-b14c-4db2-938e-35963d128d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a8a362-d930-47d5-b449-fec49325ba7a", "name": "network-vif-deleted", "tag": "a40f207c-1239-46bb-af6c-60ad2e69d6db"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:10:04.541050 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-56c57a3d-8d60-4b27-b2b7-8333fdd05fd0 req-ba7512db-b14c-4db2-938e-35963d128d24 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:04.541908 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-56c57a3d-8d60-4b27-b2b7-8333fdd05fd0 req-ba7512db-b14c-4db2-938e-35963d128d24 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:04.555339 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-56c57a3d-8d60-4b27-b2b7-8333fdd05fd0 req-ba7512db-b14c-4db2-938e-35963d128d24 service nova] Creating event network-vif-deleted:a40f207c-1239-46bb-af6c-60ad2e69d6db for instance 73a8a362-d930-47d5-b449-fec49325ba7a on hv-cinder-84213 May 26 14:10:04.580744 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-56c57a3d-8d60-4b27-b2b7-8333fdd05fd0 req-ba7512db-b14c-4db2-938e-35963d128d24 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052747 May 26 14:10:04.583456 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 680/1321] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:10:04.811508 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d4e07e21-12db-4363-b4fd-4fccfa77a3bb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:10:04.813438 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d4e07e21-12db-4363-b4fd-4fccfa77a3bb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:10:04.820925 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d4e07e21-12db-4363-b4fd-4fccfa77a3bb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:04.821823 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d4e07e21-12db-4363-b4fd-4fccfa77a3bb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:04.822897 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d4e07e21-12db-4363-b4fd-4fccfa77a3bb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:04.823772 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d4e07e21-12db-4363-b4fd-4fccfa77a3bb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:04.864313 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d4e07e21-12db-4363-b4fd-4fccfa77a3bb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:04.865174 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d4e07e21-12db-4363-b4fd-4fccfa77a3bb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:04.866856 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-d4e07e21-12db-4363-b4fd-4fccfa77a3bb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lazy-loading 'fault' on Instance uuid 73a8a362-d930-47d5-b449-fec49325ba7a {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:10:04.914062 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d4e07e21-12db-4363-b4fd-4fccfa77a3bb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:10:04.923022 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d4e07e21-12db-4363-b4fd-4fccfa77a3bb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 200 len: 1326 microversion: 2.1 time: 0.115332 May 26 14:10:04.923900 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 642/1322] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:10:04 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 1326 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:10:05.943308 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c0763304-5e67-4591-8222-78c7566227ad tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:10:05.944004 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c0763304-5e67-4591-8222-78c7566227ad tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:10:05.950305 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c0763304-5e67-4591-8222-78c7566227ad tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:05.950699 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c0763304-5e67-4591-8222-78c7566227ad tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:05.951458 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c0763304-5e67-4591-8222-78c7566227ad tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:05.951899 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c0763304-5e67-4591-8222-78c7566227ad tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:05.967698 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-c0763304-5e67-4591-8222-78c7566227ad tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] HTTP exception thrown: Instance 73a8a362-d930-47d5-b449-fec49325ba7a could not be found. May 26 14:10:05.969417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c0763304-5e67-4591-8222-78c7566227ad tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Request method failure captured: May 26 14:10:05.969417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a HTTP/1.1 May 26 14:10:05.969417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 14:10:05.969417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 14:10:05.969417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 14:10:05.969417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 14:10:05.969417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 14:10:05.969417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 14:10:05.969417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 14:10:05.969417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 14:10:05.969417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4kOqOz6Xfw7Mt9D1gY0ECU-gDuM-qtKf3oR9waq9lAk2Hb_DJG0CbV6EPrcPIzjzyWrt-djJUUgLGtAj7J-qm1OVfXcDiJuSggAE9OU5f8vT6iNvy8tk7Qom5OYSCrq_4SRJIQTVFMPamc6b0xxx_pCyfuLkFJxICBOTOVmTDaGfbk May 26 14:10:05.969417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 14:10:05.969417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 14:10:05.969417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 14:10:05.969417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 14:10:05.969417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 14:10:05.969417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 14:10:05.969417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: 3fcd25a6c4574894a8270e3a43af782d May 26 14:10:05.969417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeTestJSON-1941238879 May 26 14:10:05.969417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 14:10:05.969417 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 14:10:05.971141 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/3fcd25a6c4574894a8270e3a43af782d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/3fcd25a6c4574894a8270e3a43af782d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/3fcd25a6c4574894a8270e3a43af782d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_3fcd25a6c4574894a8270e3a43af782d", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:10:05.971141 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeTestJSON-1941238879 May 26 14:10:05.971141 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 3fcd25a6c4574894a8270e3a43af782d May 26 14:10:05.971141 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1941238879 May 26 14:10:05.971141 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeTestJSON-1941238879-project May 26 14:10:05.971141 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 14:10:05.971141 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 14:10:05.971141 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: 18906ec812ac49b8ba849775215c4318 May 26 14:10:05.971141 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeTestJSON-1941238879-project May 26 14:10:05.971141 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 14:10:05.971141 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Instance 73a8a362-d930-47d5-b449-fec49325ba7a could not be found. May 26 14:10:05.971141 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': '73a8a362-d930-47d5-b449-fec49325ba7a'} May 26 14:10:05.972090 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:10:05.972090 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:10:05.972090 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:10:05.972090 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:10:05.972090 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:10:05.972090 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:10:05.972090 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:10:05.972090 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:10:05.972090 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:10:05.972090 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:10:05.972090 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73a8a362-d930-47d5-b449-fec49325ba7a could not be found. May 26 14:10:05.972090 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:10:05.972090 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:10:05.972090 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:10:05.972090 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:10:05.972090 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:10:05.972090 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:10:05.972090 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:10:05.972090 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:10:05.972090 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:10:05.973772 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:10:05.973772 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:10:05.973772 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:10:05.973772 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:10:05.973772 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:10:05.973772 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:10:05.973772 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:10:05.973772 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73a8a362-d930-47d5-b449-fec49325ba7a could not be found. May 26 14:10:05.973772 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:10:05.973772 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:10:05.973772 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:10:05.973772 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:10:05.973772 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:10:05.973772 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:10:05.973772 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:10:05.973772 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:10:05.973772 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73a8a362-d930-47d5-b449-fec49325ba7a could not be found. May 26 14:10:05.973772 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:10:05.975169 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c0763304-5e67-4591-8222-78c7566227ad tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Returning 404 to user: Instance 73a8a362-d930-47d5-b449-fec49325ba7a could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:10:05.975169 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c0763304-5e67-4591-8222-78c7566227ad tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 404 len: 111 microversion: 2.1 time: 0.032400 May 26 14:10:05.975169 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 681/1323] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:10:05 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:10:05.979646 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-82409846-254b-4514-babd-dc14a10f344e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '.version_select at 0x7f25a9bc91f0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:10:05.997948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-82409846-254b-4514-babd-dc14a10f344e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-911970470" status: 202 len: 0 microversion: 2.1 time: 0.021958 May 26 14:10:05.998504 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 643/1324] 10.222.0.91 () {58 vars in 1217 bytes} [Thu May 26 14:10:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-911970470 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:10:06.870403 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6e553530-5808-47e3-8407-b63b21dc57d8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Action: 'create', calling method: .version_select at 0x7f25a53c7700>, body: {"keypair": {"name": "tempest-keypair-2101172393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkG15MNGpws5ffP3Mo8mg8lswVSDyYgq2R3Rg9rzESHk51iE4yTxEPyzDgB5ORO6QCxoVOQd1pDbN8weN2MgoK09eTujeqnnc8uB55tdKA+ItsA+5hsu/8u5prxlSguWg=="}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:10:06.884367 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-6e553530-5808-47e3-8407-b63b21dc57d8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Getting quotas for project 3fcd25a6c4574894a8270e3a43af782d. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 14:10:06.888093 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-6e553530-5808-47e3-8407-b63b21dc57d8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Getting quotas for user 18906ec812ac49b8ba849775215c4318 and project 3fcd25a6c4574894a8270e3a43af782d. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 14:10:06.912605 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6e553530-5808-47e3-8407-b63b21dc57d8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046031 May 26 14:10:06.913301 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 682/1325] 10.222.0.91 () {60 vars in 1158 bytes} [Thu May 26 14:10:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:10:08.213611 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1d7607e6-6772-48dd-a69c-07b88db81f9f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-338268259", "imageRef": "bcaacfae-fe2c-455f-a6e1-b08361c6fa8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "48f83048-1a6c-4ff2-af0b-d6658384b0a0"}], "security_groups": [{"name": "tempest-securitygroup--61084324"}], "key_name": "tempest-keypair-2101172393", "user_data": "}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:10:08.318639 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-1d7607e6-6772-48dd-a69c-07b88db81f9f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] validate_networks() for [('48f83048-1a6c-4ff2-af0b-d6658384b0a0', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 14:10:08.671376 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-1d7607e6-6772-48dd-a69c-07b88db81f9f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 14:10:08.671797 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-1d7607e6-6772-48dd-a69c-07b88db81f9f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 14:10:08.672272 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-1d7607e6-6772-48dd-a69c-07b88db81f9f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 14:10:08.672677 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-1d7607e6-6772-48dd-a69c-07b88db81f9f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 14:10:08.673090 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-1d7607e6-6772-48dd-a69c-07b88db81f9f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 14:10:08.682178 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d7607e6-6772-48dd-a69c-07b88db81f9f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:08.682628 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d7607e6-6772-48dd-a69c-07b88db81f9f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:08.683444 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d7607e6-6772-48dd-a69c-07b88db81f9f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:08.683876 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d7607e6-6772-48dd-a69c-07b88db81f9f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:08.701293 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-1d7607e6-6772-48dd-a69c-07b88db81f9f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Getting quotas for project 3fcd25a6c4574894a8270e3a43af782d. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 14:10:08.705958 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-1d7607e6-6772-48dd-a69c-07b88db81f9f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Getting quotas for user 18906ec812ac49b8ba849775215c4318 and project 3fcd25a6c4574894a8270e3a43af782d. Resources: {'ram', 'cores', 'instances'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 14:10:08.716661 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1d7607e6-6772-48dd-a69c-07b88db81f9f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 14:10:08.719102 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1d7607e6-6772-48dd-a69c-07b88db81f9f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bcaacfae-fe2c-455f-a6e1-b08361c6fa8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 14:10:08.769948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1d7607e6-6772-48dd-a69c-07b88db81f9f tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.560960 May 26 14:10:08.770828 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 644/1326] 10.222.0.91 () {60 vars in 1146 bytes} [Thu May 26 14:10:08 2022] POST /compute/v2.1/servers => generated 400 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 14:10:08.781423 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-153f499c-3c3e-4449-bd3f-494fb67b2d5d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:10:08.782030 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-153f499c-3c3e-4449-bd3f-494fb67b2d5d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:10:08.836280 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-153f499c-3c3e-4449-bd3f-494fb67b2d5d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:10:08.843975 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-153f499c-3c3e-4449-bd3f-494fb67b2d5d tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa" status: 200 len: 1237 microversion: 2.1 time: 0.067280 May 26 14:10:08.844754 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 683/1327] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:10:08 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:10:09.860637 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cbb45788-ca0a-45c0-ba2b-7099b49285cd tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:10:09.862066 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cbb45788-ca0a-45c0-ba2b-7099b49285cd tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:10:09.869026 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cbb45788-ca0a-45c0-ba2b-7099b49285cd tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:09.869503 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cbb45788-ca0a-45c0-ba2b-7099b49285cd tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:09.870541 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cbb45788-ca0a-45c0-ba2b-7099b49285cd tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:09.871040 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cbb45788-ca0a-45c0-ba2b-7099b49285cd tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:09.945966 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cbb45788-ca0a-45c0-ba2b-7099b49285cd tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:10:09.954019 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cbb45788-ca0a-45c0-ba2b-7099b49285cd tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa" status: 200 len: 1295 microversion: 2.1 time: 0.097378 May 26 14:10:09.954680 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 645/1328] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:10:09 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa => generated 1295 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:10:10.970412 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-396dc5a9-189b-4a6c-ae0d-f9631ca98ede tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:10:10.970947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-396dc5a9-189b-4a6c-ae0d-f9631ca98ede tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:10:10.977533 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-396dc5a9-189b-4a6c-ae0d-f9631ca98ede tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:10.977974 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-396dc5a9-189b-4a6c-ae0d-f9631ca98ede tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:10.978764 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-396dc5a9-189b-4a6c-ae0d-f9631ca98ede tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:10.979196 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-396dc5a9-189b-4a6c-ae0d-f9631ca98ede tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:11.128755 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-396dc5a9-189b-4a6c-ae0d-f9631ca98ede tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:10:11.137408 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-396dc5a9-189b-4a6c-ae0d-f9631ca98ede tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa" status: 200 len: 1361 microversion: 2.1 time: 0.170883 May 26 14:10:11.144267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 684/1329] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:10:10 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:10:11.271738 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-610a0dcc-39bc-4d02-9836-e9b63045f35f req-fecb2bb0-cf41-4de0-9865-d7153f5710f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4097ca0-adb6-4a3b-80a5-408952d9aeaa", "tag": "faa529c5-4fa1-41f5-9879-947cbac1915d"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:10:11.286483 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-610a0dcc-39bc-4d02-9836-e9b63045f35f req-fecb2bb0-cf41-4de0-9865-d7153f5710f1 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:11.287679 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-610a0dcc-39bc-4d02-9836-e9b63045f35f req-fecb2bb0-cf41-4de0-9865-d7153f5710f1 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:11.302722 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-610a0dcc-39bc-4d02-9836-e9b63045f35f req-fecb2bb0-cf41-4de0-9865-d7153f5710f1 service nova] Creating event network-changed:faa529c5-4fa1-41f5-9879-947cbac1915d for instance a4097ca0-adb6-4a3b-80a5-408952d9aeaa on hv-cinder-84213 May 26 14:10:11.308859 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-610a0dcc-39bc-4d02-9836-e9b63045f35f req-fecb2bb0-cf41-4de0-9865-d7153f5710f1 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040359 May 26 14:10:11.309558 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 646/1330] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:10:12.156088 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b3104dec-395d-40e5-a163-6d663a0adc85 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:10:12.156675 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b3104dec-395d-40e5-a163-6d663a0adc85 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:10:12.162772 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b3104dec-395d-40e5-a163-6d663a0adc85 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:12.163223 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b3104dec-395d-40e5-a163-6d663a0adc85 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:12.164001 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b3104dec-395d-40e5-a163-6d663a0adc85 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:12.164437 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b3104dec-395d-40e5-a163-6d663a0adc85 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:12.291129 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b3104dec-395d-40e5-a163-6d663a0adc85 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:10:12.298700 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b3104dec-395d-40e5-a163-6d663a0adc85 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa" status: 200 len: 1361 microversion: 2.1 time: 0.147714 May 26 14:10:12.299264 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 685/1331] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:10:12 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:10:13.316688 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b0b7883d-b332-4f42-9f8c-50bc245f9517 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:10:13.317417 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b0b7883d-b332-4f42-9f8c-50bc245f9517 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:10:13.323874 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b0b7883d-b332-4f42-9f8c-50bc245f9517 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:13.324348 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b0b7883d-b332-4f42-9f8c-50bc245f9517 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:13.325113 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b0b7883d-b332-4f42-9f8c-50bc245f9517 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:13.325611 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b0b7883d-b332-4f42-9f8c-50bc245f9517 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:13.330260 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:10:13.463052 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b0b7883d-b332-4f42-9f8c-50bc245f9517 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:10:13.471080 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b0b7883d-b332-4f42-9f8c-50bc245f9517 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa" status: 200 len: 1361 microversion: 2.1 time: 0.159215 May 26 14:10:13.471649 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 647/1332] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:10:13 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:10:14.488094 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0a3a753c-f549-4fc7-8db2-9c5bad047acb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:10:14.488702 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0a3a753c-f549-4fc7-8db2-9c5bad047acb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:10:14.495347 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0a3a753c-f549-4fc7-8db2-9c5bad047acb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:14.495798 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0a3a753c-f549-4fc7-8db2-9c5bad047acb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:14.496587 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0a3a753c-f549-4fc7-8db2-9c5bad047acb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:14.497006 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0a3a753c-f549-4fc7-8db2-9c5bad047acb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:14.625904 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0a3a753c-f549-4fc7-8db2-9c5bad047acb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:10:14.633269 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0a3a753c-f549-4fc7-8db2-9c5bad047acb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa" status: 200 len: 1361 microversion: 2.1 time: 0.149180 May 26 14:10:14.634105 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 686/1333] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:10:14 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:10:15.650933 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-902f0e3d-a674-42ec-b828-821ea34e989b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:10:15.651554 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-902f0e3d-a674-42ec-b828-821ea34e989b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:10:15.653450 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:10:15.659082 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-902f0e3d-a674-42ec-b828-821ea34e989b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:15.659534 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-902f0e3d-a674-42ec-b828-821ea34e989b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:15.660298 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-902f0e3d-a674-42ec-b828-821ea34e989b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:15.660734 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-902f0e3d-a674-42ec-b828-821ea34e989b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:15.794923 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-902f0e3d-a674-42ec-b828-821ea34e989b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:10:15.802699 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-902f0e3d-a674-42ec-b828-821ea34e989b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa" status: 200 len: 1361 microversion: 2.1 time: 0.155818 May 26 14:10:15.803273 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 648/1334] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:10:15 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:10:16.819425 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-273ee442-1631-44cb-be03-685aa2b06881 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:10:16.820711 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-273ee442-1631-44cb-be03-685aa2b06881 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:10:16.823214 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:10:16.829209 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-273ee442-1631-44cb-be03-685aa2b06881 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:16.829654 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-273ee442-1631-44cb-be03-685aa2b06881 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:16.830453 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-273ee442-1631-44cb-be03-685aa2b06881 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:16.830880 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-273ee442-1631-44cb-be03-685aa2b06881 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:16.834043 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:10:16.970375 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-94c10bdf-9edd-41a4-92c2-191321455ebd req-af3414e9-4a75-404a-99ca-629a5bb3072a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4097ca0-adb6-4a3b-80a5-408952d9aeaa", "name": "network-vif-plugged", "status": "completed", "tag": "faa529c5-4fa1-41f5-9879-947cbac1915d"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:10:16.977997 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-273ee442-1631-44cb-be03-685aa2b06881 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:10:16.981549 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-94c10bdf-9edd-41a4-92c2-191321455ebd req-af3414e9-4a75-404a-99ca-629a5bb3072a service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:16.982117 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-94c10bdf-9edd-41a4-92c2-191321455ebd req-af3414e9-4a75-404a-99ca-629a5bb3072a service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:16.988823 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-273ee442-1631-44cb-be03-685aa2b06881 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa" status: 200 len: 1361 microversion: 2.1 time: 0.173250 May 26 14:10:16.993191 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 687/1335] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:10:16 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:10:16.994604 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-94c10bdf-9edd-41a4-92c2-191321455ebd req-af3414e9-4a75-404a-99ca-629a5bb3072a service nova] Creating event network-vif-plugged:faa529c5-4fa1-41f5-9879-947cbac1915d for instance a4097ca0-adb6-4a3b-80a5-408952d9aeaa on hv-cinder-84213 May 26 14:10:16.999609 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-94c10bdf-9edd-41a4-92c2-191321455ebd req-af3414e9-4a75-404a-99ca-629a5bb3072a service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034919 May 26 14:10:17.000203 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 649/1336] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:10:18.005984 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0d0c8e14-b5f3-460b-a43c-d7728969c690 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:10:18.006701 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0d0c8e14-b5f3-460b-a43c-d7728969c690 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:10:18.013672 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0d0c8e14-b5f3-460b-a43c-d7728969c690 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:18.014158 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0d0c8e14-b5f3-460b-a43c-d7728969c690 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:18.014947 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0d0c8e14-b5f3-460b-a43c-d7728969c690 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:18.015388 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0d0c8e14-b5f3-460b-a43c-d7728969c690 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:18.156407 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0d0c8e14-b5f3-460b-a43c-d7728969c690 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:10:18.163880 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0d0c8e14-b5f3-460b-a43c-d7728969c690 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa" status: 200 len: 1361 microversion: 2.1 time: 0.161916 May 26 14:10:18.164443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 688/1337] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:10:18 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:10:19.181011 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-32484e72-a90c-4d76-9301-249bb72e2f75 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:10:19.181735 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-32484e72-a90c-4d76-9301-249bb72e2f75 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:10:19.184305 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:10:19.184946 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=6 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:10:19.191122 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-32484e72-a90c-4d76-9301-249bb72e2f75 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:19.191844 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-32484e72-a90c-4d76-9301-249bb72e2f75 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:19.192917 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-32484e72-a90c-4d76-9301-249bb72e2f75 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:19.193561 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-32484e72-a90c-4d76-9301-249bb72e2f75 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:19.331246 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-32484e72-a90c-4d76-9301-249bb72e2f75 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:10:19.339317 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-32484e72-a90c-4d76-9301-249bb72e2f75 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa" status: 200 len: 1361 microversion: 2.1 time: 0.162426 May 26 14:10:19.339961 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 650/1338] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:10:19 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:10:20.360656 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9cf5e8c8-576b-4c1c-9970-adfb90202510 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:10:20.361320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9cf5e8c8-576b-4c1c-9970-adfb90202510 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:10:20.363224 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=6 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:10:20.368890 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9cf5e8c8-576b-4c1c-9970-adfb90202510 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:20.369366 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9cf5e8c8-576b-4c1c-9970-adfb90202510 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:20.370132 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9cf5e8c8-576b-4c1c-9970-adfb90202510 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:20.370572 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9cf5e8c8-576b-4c1c-9970-adfb90202510 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:20.500154 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9cf5e8c8-576b-4c1c-9970-adfb90202510 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:10:20.508125 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9cf5e8c8-576b-4c1c-9970-adfb90202510 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa" status: 200 len: 1547 microversion: 2.1 time: 0.151981 May 26 14:10:20.508977 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 689/1339] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:10:20 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:10:20.524611 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3d7bdf76-0f3a-42b5-af90-11865e8daf99 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:10:20.525183 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3d7bdf76-0f3a-42b5-af90-11865e8daf99 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:10:20.532212 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3d7bdf76-0f3a-42b5-af90-11865e8daf99 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:20.532661 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3d7bdf76-0f3a-42b5-af90-11865e8daf99 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:20.533481 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3d7bdf76-0f3a-42b5-af90-11865e8daf99 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:20.533922 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3d7bdf76-0f3a-42b5-af90-11865e8daf99 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:20.610835 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3d7bdf76-0f3a-42b5-af90-11865e8daf99 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090064 May 26 14:10:20.611428 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 651/1340] 10.222.0.91 () {58 vars in 1274 bytes} [Thu May 26 14:10:20 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:10:21.568570 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-cf00c5e2-2aec-4c3a-b722-cd1ebe99c07e req-16fbf30d-20f0-4433-b24d-4b9a21450b4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4097ca0-adb6-4a3b-80a5-408952d9aeaa", "tag": "faa529c5-4fa1-41f5-9879-947cbac1915d"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:10:21.578009 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-cf00c5e2-2aec-4c3a-b722-cd1ebe99c07e req-16fbf30d-20f0-4433-b24d-4b9a21450b4b service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:10:21.578627 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-cf00c5e2-2aec-4c3a-b722-cd1ebe99c07e req-16fbf30d-20f0-4433-b24d-4b9a21450b4b service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:10:21.590074 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-cf00c5e2-2aec-4c3a-b722-cd1ebe99c07e req-16fbf30d-20f0-4433-b24d-4b9a21450b4b service nova] Creating event network-changed:faa529c5-4fa1-41f5-9879-947cbac1915d for instance a4097ca0-adb6-4a3b-80a5-408952d9aeaa on hv-cinder-84213 May 26 14:10:21.595187 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-cf00c5e2-2aec-4c3a-b722-cd1ebe99c07e req-16fbf30d-20f0-4433-b24d-4b9a21450b4b service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030333 May 26 14:10:21.595849 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 690/1341] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:11:36.562476 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=7 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:11:36.563132 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=22 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:11:36.568155 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fbf75d70-a3b6-4c24-8f16-6bb1850907d0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:11:36.568654 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-fbf75d70-a3b6-4c24-8f16-6bb1850907d0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:11:36.575455 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fbf75d70-a3b6-4c24-8f16-6bb1850907d0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:36.575908 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fbf75d70-a3b6-4c24-8f16-6bb1850907d0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:36.576678 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fbf75d70-a3b6-4c24-8f16-6bb1850907d0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:36.577112 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fbf75d70-a3b6-4c24-8f16-6bb1850907d0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:36.601398 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-fbf75d70-a3b6-4c24-8f16-6bb1850907d0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/ips" status: 200 len: 146 microversion: 2.1 time: 0.040786 May 26 14:11:36.601977 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 652/1342] 10.222.0.91 () {58 vars in 1247 bytes} [Thu May 26 14:11:36 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:11:37.914539 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c882a50-267d-400d-8af5-8137ef0b79bb] AMQP server on 10.222.0.91:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 14:11:37.915122 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=7 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:11:37.916113 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=19 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:11:37.920767 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-69d8294d-5030-47cb-99df-5a5cec9983c6 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7255173-421a-4a4f-bb59-e6029eb3a158"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:11:37.921943 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-69d8294d-5030-47cb-99df-5a5cec9983c6 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:11:37.929449 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-69d8294d-5030-47cb-99df-5a5cec9983c6 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:37.929902 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-69d8294d-5030-47cb-99df-5a5cec9983c6 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:37.930667 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-69d8294d-5030-47cb-99df-5a5cec9983c6 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:37.931107 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-69d8294d-5030-47cb-99df-5a5cec9983c6 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:38.922362 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c882a50-267d-400d-8af5-8137ef0b79bb] Reconnected to AMQP server on 10.222.0.91:5672 via [amqp] client with port 41044. May 26 14:11:39.039673 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-69d8294d-5030-47cb-99df-5a5cec9983c6 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "POST /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.126687 May 26 14:11:39.040281 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 691/1343] 10.222.0.91 () {60 vars in 1322 bytes} [Thu May 26 14:11:37 2022] POST /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/os-volume_attachments => generated 194 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:11:46.532840 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b51464da-7b9a-4f3a-b2b6-8767bc6dfe44 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:11:46.534351 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b51464da-7b9a-4f3a-b2b6-8767bc6dfe44 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:11:46.540286 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b51464da-7b9a-4f3a-b2b6-8767bc6dfe44 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:46.540725 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b51464da-7b9a-4f3a-b2b6-8767bc6dfe44 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:46.541513 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b51464da-7b9a-4f3a-b2b6-8767bc6dfe44 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:46.541942 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b51464da-7b9a-4f3a-b2b6-8767bc6dfe44 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:46.570045 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b51464da-7b9a-4f3a-b2b6-8767bc6dfe44 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041210 May 26 14:11:46.570583 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 653/1344] 10.222.0.91 () {58 vars in 1301 bytes} [Thu May 26 14:11:46 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:11:46.582071 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3a8f44e1-5a14-40a9-8b7c-8bf119ca6e3b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:11:46.582689 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3a8f44e1-5a14-40a9-8b7c-8bf119ca6e3b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:11:46.588796 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3a8f44e1-5a14-40a9-8b7c-8bf119ca6e3b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:46.589280 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3a8f44e1-5a14-40a9-8b7c-8bf119ca6e3b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:46.590044 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3a8f44e1-5a14-40a9-8b7c-8bf119ca6e3b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:46.590479 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3a8f44e1-5a14-40a9-8b7c-8bf119ca6e3b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:46.618438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3a8f44e1-5a14-40a9-8b7c-8bf119ca6e3b tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/os-volume_attachments/c7255173-421a-4a4f-bb59-e6029eb3a158" status: 200 len: 194 microversion: 2.1 time: 0.041936 May 26 14:11:46.619011 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 692/1345] 10.222.0.91 () {58 vars in 1412 bytes} [Thu May 26 14:11:46 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/os-volume_attachments/c7255173-421a-4a4f-bb59-e6029eb3a158 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:11:47.933482 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-04aee739-bbed-4899-97c4-2cfc3608c3a8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41f9873a-3703-4a81-ad52-8c87e71a5ac8"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:11:47.934570 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-04aee739-bbed-4899-97c4-2cfc3608c3a8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:11:47.941655 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-04aee739-bbed-4899-97c4-2cfc3608c3a8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:47.942105 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-04aee739-bbed-4899-97c4-2cfc3608c3a8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:47.942864 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-04aee739-bbed-4899-97c4-2cfc3608c3a8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:47.943310 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-04aee739-bbed-4899-97c4-2cfc3608c3a8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:48.247299 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-04aee739-bbed-4899-97c4-2cfc3608c3a8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "POST /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317507 May 26 14:11:48.247906 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 654/1346] 10.222.0.91 () {60 vars in 1322 bytes} [Thu May 26 14:11:47 2022] POST /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:11:55.754438 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-00ed6e3a-92e6-466b-b327-9a810f490bd8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:11:55.755356 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-00ed6e3a-92e6-466b-b327-9a810f490bd8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:11:55.762197 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-00ed6e3a-92e6-466b-b327-9a810f490bd8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:55.762639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-00ed6e3a-92e6-466b-b327-9a810f490bd8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:55.763394 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-00ed6e3a-92e6-466b-b327-9a810f490bd8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:55.763819 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-00ed6e3a-92e6-466b-b327-9a810f490bd8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:55.792860 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-00ed6e3a-92e6-466b-b327-9a810f490bd8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043163 May 26 14:11:55.793442 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 693/1347] 10.222.0.91 () {58 vars in 1301 bytes} [Thu May 26 14:11:55 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:11:55.933004 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0aa87ac4-784e-4bf2-92a2-44c57c54b500 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:11:55.933600 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0aa87ac4-784e-4bf2-92a2-44c57c54b500 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:11:55.940774 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0aa87ac4-784e-4bf2-92a2-44c57c54b500 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:55.941256 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0aa87ac4-784e-4bf2-92a2-44c57c54b500 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:55.942018 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0aa87ac4-784e-4bf2-92a2-44c57c54b500 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:55.942451 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0aa87ac4-784e-4bf2-92a2-44c57c54b500 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:55.970694 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0aa87ac4-784e-4bf2-92a2-44c57c54b500 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/os-volume_attachments/c7255173-421a-4a4f-bb59-e6029eb3a158" status: 200 len: 194 microversion: 2.1 time: 0.042511 May 26 14:11:55.971284 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 655/1348] 10.222.0.91 () {58 vars in 1412 bytes} [Thu May 26 14:11:55 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/os-volume_attachments/c7255173-421a-4a4f-bb59-e6029eb3a158 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:11:55.981007 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0af920c1-562a-497c-9dd9-4c8389ebe36a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:11:55.981530 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0af920c1-562a-497c-9dd9-4c8389ebe36a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:11:55.987920 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0af920c1-562a-497c-9dd9-4c8389ebe36a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:55.988364 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0af920c1-562a-497c-9dd9-4c8389ebe36a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:55.989118 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0af920c1-562a-497c-9dd9-4c8389ebe36a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:55.989588 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0af920c1-562a-497c-9dd9-4c8389ebe36a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:56.072692 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-0af920c1-562a-497c-9dd9-4c8389ebe36a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lazy-loading 'services' on Instance uuid a4097ca0-adb6-4a3b-80a5-408952d9aeaa {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:11:56.148051 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0af920c1-562a-497c-9dd9-4c8389ebe36a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "DELETE /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/os-volume_attachments/c7255173-421a-4a4f-bb59-e6029eb3a158" status: 202 len: 0 microversion: 2.1 time: 0.170779 May 26 14:11:56.148643 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 694/1349] 10.222.0.91 () {58 vars in 1415 bytes} [Thu May 26 14:11:55 2022] DELETE /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/os-volume_attachments/c7255173-421a-4a4f-bb59-e6029eb3a158 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:11:57.272133 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-64e3f7e2-eff0-4770-93b6-d2c2ac3353da tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:11:57.272799 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-64e3f7e2-eff0-4770-93b6-d2c2ac3353da tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:11:57.279578 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-64e3f7e2-eff0-4770-93b6-d2c2ac3353da tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:57.280022 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-64e3f7e2-eff0-4770-93b6-d2c2ac3353da tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:57.280783 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-64e3f7e2-eff0-4770-93b6-d2c2ac3353da tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:57.281235 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-64e3f7e2-eff0-4770-93b6-d2c2ac3353da tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:57.311496 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-64e3f7e2-eff0-4770-93b6-d2c2ac3353da tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/os-volume_attachments/41f9873a-3703-4a81-ad52-8c87e71a5ac8" status: 200 len: 194 microversion: 2.1 time: 0.044180 May 26 14:11:57.312143 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 656/1350] 10.222.0.91 () {58 vars in 1412 bytes} [Thu May 26 14:11:57 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/os-volume_attachments/41f9873a-3703-4a81-ad52-8c87e71a5ac8 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:11:57.323615 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e0a7b5ef-2cbf-4a20-80bf-94d5c3d68ea1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:11:57.324203 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e0a7b5ef-2cbf-4a20-80bf-94d5c3d68ea1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:11:57.331296 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e0a7b5ef-2cbf-4a20-80bf-94d5c3d68ea1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:57.331765 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e0a7b5ef-2cbf-4a20-80bf-94d5c3d68ea1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:57.332519 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e0a7b5ef-2cbf-4a20-80bf-94d5c3d68ea1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:57.332983 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e0a7b5ef-2cbf-4a20-80bf-94d5c3d68ea1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:57.421854 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-e0a7b5ef-2cbf-4a20-80bf-94d5c3d68ea1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lazy-loading 'services' on Instance uuid a4097ca0-adb6-4a3b-80a5-408952d9aeaa {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:11:57.494223 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e0a7b5ef-2cbf-4a20-80bf-94d5c3d68ea1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "DELETE /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/os-volume_attachments/41f9873a-3703-4a81-ad52-8c87e71a5ac8" status: 202 len: 0 microversion: 2.1 time: 0.175326 May 26 14:11:57.494803 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 695/1351] 10.222.0.91 () {58 vars in 1415 bytes} [Thu May 26 14:11:57 2022] DELETE /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/os-volume_attachments/41f9873a-3703-4a81-ad52-8c87e71a5ac8 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:11:58.659235 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9fac2bd7-1268-410f-838d-560fdb637850 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:11:58.660261 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9fac2bd7-1268-410f-838d-560fdb637850 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:11:58.667112 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9fac2bd7-1268-410f-838d-560fdb637850 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:58.667560 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9fac2bd7-1268-410f-838d-560fdb637850 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:58.668334 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9fac2bd7-1268-410f-838d-560fdb637850 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:58.668789 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9fac2bd7-1268-410f-838d-560fdb637850 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:58.697254 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9fac2bd7-1268-410f-838d-560fdb637850 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041915 May 26 14:11:58.697802 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 657/1352] 10.222.0.91 () {58 vars in 1301 bytes} [Thu May 26 14:11:58 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 14:11:58.806953 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a6b2c022-f8f8-4fcd-946b-1b807effc8e8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:11:58.807927 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a6b2c022-f8f8-4fcd-946b-1b807effc8e8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:11:58.814180 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a6b2c022-f8f8-4fcd-946b-1b807effc8e8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:58.815119 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a6b2c022-f8f8-4fcd-946b-1b807effc8e8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:58.815874 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a6b2c022-f8f8-4fcd-946b-1b807effc8e8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:58.816308 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a6b2c022-f8f8-4fcd-946b-1b807effc8e8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:58.845964 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a6b2c022-f8f8-4fcd-946b-1b807effc8e8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043664 May 26 14:11:58.846540 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 696/1353] 10.222.0.91 () {58 vars in 1301 bytes} [Thu May 26 14:11:58 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 14:11:58.904793 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-16d8bd77-eb99-4468-b3e4-592d5688bdfb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:11:58.905353 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-16d8bd77-eb99-4468-b3e4-592d5688bdfb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:11:58.911457 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-16d8bd77-eb99-4468-b3e4-592d5688bdfb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:58.911921 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-16d8bd77-eb99-4468-b3e4-592d5688bdfb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:58.912698 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-16d8bd77-eb99-4468-b3e4-592d5688bdfb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:58.913136 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-16d8bd77-eb99-4468-b3e4-592d5688bdfb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:58.938456 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-16d8bd77-eb99-4468-b3e4-592d5688bdfb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 14:11:59.020057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-16d8bd77-eb99-4468-b3e4-592d5688bdfb tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "DELETE /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa" status: 204 len: 0 microversion: 2.1 time: 0.116884 May 26 14:11:59.020057 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 658/1354] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 14:11:58 2022] DELETE /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 14:11:59.028074 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-90009aae-a6b6-4624-9f53-3b0ea41e42b0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:11:59.028638 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-90009aae-a6b6-4624-9f53-3b0ea41e42b0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:11:59.034871 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-90009aae-a6b6-4624-9f53-3b0ea41e42b0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:59.035323 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-90009aae-a6b6-4624-9f53-3b0ea41e42b0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:59.036103 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-90009aae-a6b6-4624-9f53-3b0ea41e42b0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:11:59.036543 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-90009aae-a6b6-4624-9f53-3b0ea41e42b0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:11:59.175676 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-90009aae-a6b6-4624-9f53-3b0ea41e42b0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:11:59.183322 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-90009aae-a6b6-4624-9f53-3b0ea41e42b0 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa" status: 200 len: 1672 microversion: 2.1 time: 0.159286 May 26 14:11:59.183896 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 697/1355] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:11:59 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:12:00.201646 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-09b4f361-eef6-4873-9cd0-88feeb81d74a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:12:00.202338 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-09b4f361-eef6-4873-9cd0-88feeb81d74a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:12:00.209610 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09b4f361-eef6-4873-9cd0-88feeb81d74a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:12:00.210054 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09b4f361-eef6-4873-9cd0-88feeb81d74a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:12:00.210821 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09b4f361-eef6-4873-9cd0-88feeb81d74a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:12:00.211252 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09b4f361-eef6-4873-9cd0-88feeb81d74a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:12:00.340890 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-09b4f361-eef6-4873-9cd0-88feeb81d74a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:12:00.348526 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-09b4f361-eef6-4873-9cd0-88feeb81d74a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa" status: 200 len: 1672 microversion: 2.1 time: 0.151153 May 26 14:12:00.349088 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 659/1356] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:12:00 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:12:01.365696 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-706c7061-067e-4377-be31-5eb426c7d5d8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:12:01.366326 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-706c7061-067e-4377-be31-5eb426c7d5d8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:12:01.378777 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-706c7061-067e-4377-be31-5eb426c7d5d8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:12:01.379231 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-706c7061-067e-4377-be31-5eb426c7d5d8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:12:01.380024 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-706c7061-067e-4377-be31-5eb426c7d5d8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:12:01.380462 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-706c7061-067e-4377-be31-5eb426c7d5d8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:12:01.510163 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-706c7061-067e-4377-be31-5eb426c7d5d8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:12:01.518751 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-706c7061-067e-4377-be31-5eb426c7d5d8 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa" status: 200 len: 1672 microversion: 2.1 time: 0.156889 May 26 14:12:01.519337 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 698/1357] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:12:01 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:12:02.069441 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-21109e48-f519-4c2e-87d5-e3888a5667b7 req-73caac1d-61da-404c-b8e1-0bdfaecefeb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4097ca0-adb6-4a3b-80a5-408952d9aeaa", "name": "network-vif-deleted", "tag": "faa529c5-4fa1-41f5-9879-947cbac1915d"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:12:02.079391 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-21109e48-f519-4c2e-87d5-e3888a5667b7 req-73caac1d-61da-404c-b8e1-0bdfaecefeb8 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:12:02.079840 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-21109e48-f519-4c2e-87d5-e3888a5667b7 req-73caac1d-61da-404c-b8e1-0bdfaecefeb8 service nova] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:12:02.091357 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-21109e48-f519-4c2e-87d5-e3888a5667b7 req-73caac1d-61da-404c-b8e1-0bdfaecefeb8 service nova] Creating event network-vif-deleted:faa529c5-4fa1-41f5-9879-947cbac1915d for instance a4097ca0-adb6-4a3b-80a5-408952d9aeaa on hv-cinder-84213 May 26 14:12:02.096994 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-21109e48-f519-4c2e-87d5-e3888a5667b7 req-73caac1d-61da-404c-b8e1-0bdfaecefeb8 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030608 May 26 14:12:02.097870 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 660/1358] 10.222.0.91 () {64 vars in 1317 bytes} [Thu May 26 14:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:12:02.536742 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-37a6569a-4dc5-40fa-9fbd-7dc9a00507c3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:12:02.537407 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-37a6569a-4dc5-40fa-9fbd-7dc9a00507c3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:12:02.544133 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-37a6569a-4dc5-40fa-9fbd-7dc9a00507c3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:12:02.544856 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-37a6569a-4dc5-40fa-9fbd-7dc9a00507c3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:12:02.545864 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-37a6569a-4dc5-40fa-9fbd-7dc9a00507c3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:12:02.546464 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-37a6569a-4dc5-40fa-9fbd-7dc9a00507c3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:12:02.581514 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-37a6569a-4dc5-40fa-9fbd-7dc9a00507c3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:12:02.581958 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-37a6569a-4dc5-40fa-9fbd-7dc9a00507c3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:12:02.582592 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-37a6569a-4dc5-40fa-9fbd-7dc9a00507c3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lazy-loading 'fault' on Instance uuid a4097ca0-adb6-4a3b-80a5-408952d9aeaa {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:12:02.628807 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-37a6569a-4dc5-40fa-9fbd-7dc9a00507c3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18906ec812ac49b8ba849775215c4318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcd25a6c4574894a8270e3a43af782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:12:02.637862 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-37a6569a-4dc5-40fa-9fbd-7dc9a00507c3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa" status: 200 len: 1327 microversion: 2.1 time: 0.105690 May 26 14:12:02.639524 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 699/1359] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:12:02 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:12:03.657948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-43beecf6-3936-4e04-93f0-4c53ad72def5 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:12:03.658648 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-43beecf6-3936-4e04-93f0-4c53ad72def5 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:12:03.664931 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43beecf6-3936-4e04-93f0-4c53ad72def5 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:12:03.665417 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43beecf6-3936-4e04-93f0-4c53ad72def5 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:12:03.666189 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43beecf6-3936-4e04-93f0-4c53ad72def5 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:12:03.666631 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43beecf6-3936-4e04-93f0-4c53ad72def5 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:12:03.680314 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-43beecf6-3936-4e04-93f0-4c53ad72def5 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] HTTP exception thrown: Instance a4097ca0-adb6-4a3b-80a5-408952d9aeaa could not be found. May 26 14:12:03.682001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-43beecf6-3936-4e04-93f0-4c53ad72def5 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Request method failure captured: May 26 14:12:03.682001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa HTTP/1.1 May 26 14:12:03.682001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 14:12:03.682001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 14:12:03.682001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 14:12:03.682001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 14:12:03.682001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 14:12:03.682001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 14:12:03.682001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 14:12:03.682001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 14:12:03.682001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4kOqOz6Xfw7Mt9D1gY0ECU-gDuM-qtKf3oR9waq9lAk2Hb_DJG0CbV6EPrcPIzjzyWrt-djJUUgLGtAj7J-qm1OVfXcDiJuSggAE9OU5f8vT6iNvy8tk7Qom5OYSCrq_4SRJIQTVFMPamc6b0xxx_pCyfuLkFJxICBOTOVmTDaGfbk May 26 14:12:03.682001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 14:12:03.682001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 14:12:03.682001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 14:12:03.682001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 14:12:03.682001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 14:12:03.682001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 14:12:03.682001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: 3fcd25a6c4574894a8270e3a43af782d May 26 14:12:03.682001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeTestJSON-1941238879 May 26 14:12:03.682001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 14:12:03.682001 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 14:12:03.683814 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/3fcd25a6c4574894a8270e3a43af782d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/3fcd25a6c4574894a8270e3a43af782d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/3fcd25a6c4574894a8270e3a43af782d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_3fcd25a6c4574894a8270e3a43af782d", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:12:03.683814 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeTestJSON-1941238879 May 26 14:12:03.683814 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 3fcd25a6c4574894a8270e3a43af782d May 26 14:12:03.683814 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1941238879 May 26 14:12:03.683814 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeTestJSON-1941238879-project May 26 14:12:03.683814 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 14:12:03.683814 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 14:12:03.683814 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: 18906ec812ac49b8ba849775215c4318 May 26 14:12:03.683814 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeTestJSON-1941238879-project May 26 14:12:03.683814 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: > May 26 14:12:03.683814 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Instance a4097ca0-adb6-4a3b-80a5-408952d9aeaa could not be found. May 26 14:12:03.683814 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'id': 'a4097ca0-adb6-4a3b-80a5-408952d9aeaa'} May 26 14:12:03.684990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:12:03.684990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:12:03.684990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:12:03.684990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:12:03.684990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:12:03.684990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:12:03.684990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:12:03.684990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:12:03.684990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:12:03.684990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:12:03.684990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4097ca0-adb6-4a3b-80a5-408952d9aeaa could not be found. May 26 14:12:03.684990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:12:03.684990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:12:03.684990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:12:03.684990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:12:03.684990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:12:03.684990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:12:03.684990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:12:03.684990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:12:03.684990 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:12:03.686721 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:12:03.686721 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:12:03.686721 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:12:03.686721 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:12:03.686721 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:12:03.686721 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:12:03.686721 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:12:03.686721 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4097ca0-adb6-4a3b-80a5-408952d9aeaa could not be found. May 26 14:12:03.686721 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:12:03.686721 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:12:03.686721 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:12:03.686721 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:12:03.686721 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:12:03.686721 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:12:03.686721 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:12:03.686721 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:12:03.686721 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4097ca0-adb6-4a3b-80a5-408952d9aeaa could not be found. May 26 14:12:03.686721 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:12:03.688417 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-43beecf6-3936-4e04-93f0-4c53ad72def5 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Returning 404 to user: Instance a4097ca0-adb6-4a3b-80a5-408952d9aeaa could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:12:03.688417 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-43beecf6-3936-4e04-93f0-4c53ad72def5 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa" status: 404 len: 111 microversion: 2.1 time: 0.030249 May 26 14:12:03.688417 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 661/1360] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:12:03 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:12:03.692959 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7996b2da-b51a-4b34-bb8b-856923a8fde1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '.version_select at 0x7f25a49a5550>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:12:03.710350 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7996b2da-b51a-4b34-bb8b-856923a8fde1 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2101172393" status: 202 len: 0 microversion: 2.1 time: 0.021766 May 26 14:12:03.710929 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 700/1361] 10.222.0.91 () {58 vars in 1220 bytes} [Thu May 26 14:12:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2101172393 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:12:06.601092 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cee880b7-ed6e-46fc-943c-272e0310e2b3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:12:06.601649 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cee880b7-ed6e-46fc-943c-272e0310e2b3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:12:06.604008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:12:06.609433 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cee880b7-ed6e-46fc-943c-272e0310e2b3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:12:06.609895 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cee880b7-ed6e-46fc-943c-272e0310e2b3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:12:06.610660 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cee880b7-ed6e-46fc-943c-272e0310e2b3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:12:06.611126 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cee880b7-ed6e-46fc-943c-272e0310e2b3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:12:06.615711 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:12:06.625922 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-cee880b7-ed6e-46fc-943c-272e0310e2b3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] HTTP exception thrown: Instance a4097ca0-adb6-4a3b-80a5-408952d9aeaa could not be found. May 26 14:12:06.627489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cee880b7-ed6e-46fc-943c-272e0310e2b3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Request method failure captured: May 26 14:12:06.627489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: DELETE /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa HTTP/1.1 May 26 14:12:06.627489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 14:12:06.627489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 14:12:06.627489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 14:12:06.627489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 14:12:06.627489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 14:12:06.627489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 14:12:06.627489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 14:12:06.627489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 14:12:06.627489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4kOqOz6Xfw7Mt9D1gY0ECU-gDuM-qtKf3oR9waq9lAk2Hb_DJG0CbV6EPrcPIzjzyWrt-djJUUgLGtAj7J-qm1OVfXcDiJuSggAE9OU5f8vT6iNvy8tk7Qom5OYSCrq_4SRJIQTVFMPamc6b0xxx_pCyfuLkFJxICBOTOVmTDaGfbk May 26 14:12:06.627489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 14:12:06.627489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 14:12:06.627489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 14:12:06.627489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 14:12:06.627489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 14:12:06.627489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 14:12:06.627489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: 3fcd25a6c4574894a8270e3a43af782d May 26 14:12:06.627489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeTestJSON-1941238879 May 26 14:12:06.627489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 14:12:06.627489 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 14:12:06.629188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/3fcd25a6c4574894a8270e3a43af782d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/3fcd25a6c4574894a8270e3a43af782d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/3fcd25a6c4574894a8270e3a43af782d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_3fcd25a6c4574894a8270e3a43af782d", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:12:06.629188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeTestJSON-1941238879 May 26 14:12:06.629188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 3fcd25a6c4574894a8270e3a43af782d May 26 14:12:06.629188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1941238879 May 26 14:12:06.629188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeTestJSON-1941238879-project May 26 14:12:06.629188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 14:12:06.629188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 14:12:06.629188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: 18906ec812ac49b8ba849775215c4318 May 26 14:12:06.629188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeTestJSON-1941238879-project May 26 14:12:06.629188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: > May 26 14:12:06.629188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Instance a4097ca0-adb6-4a3b-80a5-408952d9aeaa could not be found. May 26 14:12:06.629188 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'id': 'a4097ca0-adb6-4a3b-80a5-408952d9aeaa'} May 26 14:12:06.630086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:12:06.630086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:12:06.630086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:12:06.630086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:12:06.630086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:12:06.630086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:12:06.630086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:12:06.630086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:12:06.630086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:12:06.630086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:12:06.630086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4097ca0-adb6-4a3b-80a5-408952d9aeaa could not be found. May 26 14:12:06.630086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:12:06.630086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:12:06.630086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:12:06.630086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:12:06.630086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:12:06.630086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:12:06.630086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:12:06.630086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:12:06.630086 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:12:06.631902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:12:06.631902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 14:12:06.631902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 14:12:06.631902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 14:12:06.631902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 14:12:06.631902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:12:06.631902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:12:06.631902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:12:06.631902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:12:06.631902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4097ca0-adb6-4a3b-80a5-408952d9aeaa could not be found. May 26 14:12:06.631902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:12:06.631902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:12:06.631902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:12:06.631902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:12:06.631902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:12:06.631902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:12:06.631902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:12:06.631902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:12:06.631902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4097ca0-adb6-4a3b-80a5-408952d9aeaa could not be found. May 26 14:12:06.631902 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:12:06.633513 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cee880b7-ed6e-46fc-943c-272e0310e2b3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Returning 404 to user: Instance a4097ca0-adb6-4a3b-80a5-408952d9aeaa could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:12:06.633513 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cee880b7-ed6e-46fc-943c-272e0310e2b3 tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "DELETE /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa" status: 404 len: 111 microversion: 2.1 time: 0.031701 May 26 14:12:06.633513 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 662/1362] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 14:12:06 2022] DELETE /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:12:06.638414 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-af76acca-80ad-45e6-a345-5951d31458ec tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:12:06.639032 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-af76acca-80ad-45e6-a345-5951d31458ec tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: a4097ca0-adb6-4a3b-80a5-408952d9aeaa] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:12:06.646214 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-af76acca-80ad-45e6-a345-5951d31458ec tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:12:06.646671 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-af76acca-80ad-45e6-a345-5951d31458ec tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:12:06.647443 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-af76acca-80ad-45e6-a345-5951d31458ec tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:12:06.647884 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-af76acca-80ad-45e6-a345-5951d31458ec tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:12:06.661348 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-af76acca-80ad-45e6-a345-5951d31458ec tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] HTTP exception thrown: Instance a4097ca0-adb6-4a3b-80a5-408952d9aeaa could not be found. May 26 14:12:06.662986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-af76acca-80ad-45e6-a345-5951d31458ec tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Request method failure captured: May 26 14:12:06.662986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa HTTP/1.1 May 26 14:12:06.662986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 14:12:06.662986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 14:12:06.662986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 14:12:06.662986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 14:12:06.662986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 14:12:06.662986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 14:12:06.662986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 14:12:06.662986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 14:12:06.662986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4kOqOz6Xfw7Mt9D1gY0ECU-gDuM-qtKf3oR9waq9lAk2Hb_DJG0CbV6EPrcPIzjzyWrt-djJUUgLGtAj7J-qm1OVfXcDiJuSggAE9OU5f8vT6iNvy8tk7Qom5OYSCrq_4SRJIQTVFMPamc6b0xxx_pCyfuLkFJxICBOTOVmTDaGfbk May 26 14:12:06.662986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 14:12:06.662986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 14:12:06.662986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 14:12:06.662986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 14:12:06.662986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 14:12:06.662986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 14:12:06.662986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: 3fcd25a6c4574894a8270e3a43af782d May 26 14:12:06.662986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeTestJSON-1941238879 May 26 14:12:06.662986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 14:12:06.662986 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 14:12:06.664670 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/3fcd25a6c4574894a8270e3a43af782d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/3fcd25a6c4574894a8270e3a43af782d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/3fcd25a6c4574894a8270e3a43af782d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_3fcd25a6c4574894a8270e3a43af782d", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:12:06.664670 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeTestJSON-1941238879 May 26 14:12:06.664670 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 3fcd25a6c4574894a8270e3a43af782d May 26 14:12:06.664670 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1941238879 May 26 14:12:06.664670 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeTestJSON-1941238879-project May 26 14:12:06.664670 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 14:12:06.664670 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 14:12:06.664670 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: 18906ec812ac49b8ba849775215c4318 May 26 14:12:06.664670 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeTestJSON-1941238879-project May 26 14:12:06.664670 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 14:12:06.664670 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Instance a4097ca0-adb6-4a3b-80a5-408952d9aeaa could not be found. May 26 14:12:06.664670 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': 'a4097ca0-adb6-4a3b-80a5-408952d9aeaa'} May 26 14:12:06.665639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:12:06.665639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:12:06.665639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:12:06.665639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:12:06.665639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:12:06.665639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:12:06.665639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:12:06.665639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:12:06.665639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:12:06.665639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:12:06.665639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4097ca0-adb6-4a3b-80a5-408952d9aeaa could not be found. May 26 14:12:06.665639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:12:06.665639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:12:06.665639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:12:06.665639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:12:06.665639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:12:06.665639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:12:06.665639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:12:06.665639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:12:06.665639 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:12:06.667320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:12:06.667320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:12:06.667320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:12:06.667320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:12:06.667320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:12:06.667320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:12:06.667320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:12:06.667320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4097ca0-adb6-4a3b-80a5-408952d9aeaa could not be found. May 26 14:12:06.667320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:12:06.667320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:12:06.667320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:12:06.667320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:12:06.667320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:12:06.667320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:12:06.667320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:12:06.667320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:12:06.667320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4097ca0-adb6-4a3b-80a5-408952d9aeaa could not be found. May 26 14:12:06.667320 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:12:06.668719 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-af76acca-80ad-45e6-a345-5951d31458ec tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Returning 404 to user: Instance a4097ca0-adb6-4a3b-80a5-408952d9aeaa could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:12:06.668719 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-af76acca-80ad-45e6-a345-5951d31458ec tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa" status: 404 len: 111 microversion: 2.1 time: 0.030462 May 26 14:12:06.668719 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 701/1363] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:12:06 2022] GET /compute/v2.1/servers/a4097ca0-adb6-4a3b-80a5-408952d9aeaa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:12:07.803384 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7641c6ee-abc8-4fd9-8d99-08977bddb49e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:12:07.804080 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7641c6ee-abc8-4fd9-8d99-08977bddb49e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:12:07.811227 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7641c6ee-abc8-4fd9-8d99-08977bddb49e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:12:07.811672 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7641c6ee-abc8-4fd9-8d99-08977bddb49e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:12:07.812485 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7641c6ee-abc8-4fd9-8d99-08977bddb49e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:12:07.812924 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7641c6ee-abc8-4fd9-8d99-08977bddb49e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:12:07.826413 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-7641c6ee-abc8-4fd9-8d99-08977bddb49e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] HTTP exception thrown: Instance 73a8a362-d930-47d5-b449-fec49325ba7a could not be found. May 26 14:12:07.827948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7641c6ee-abc8-4fd9-8d99-08977bddb49e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Request method failure captured: May 26 14:12:07.827948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: DELETE /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a HTTP/1.1 May 26 14:12:07.827948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 14:12:07.827948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 14:12:07.827948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 14:12:07.827948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 14:12:07.827948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 14:12:07.827948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 14:12:07.827948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 14:12:07.827948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 14:12:07.827948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4kOqOz6Xfw7Mt9D1gY0ECU-gDuM-qtKf3oR9waq9lAk2Hb_DJG0CbV6EPrcPIzjzyWrt-djJUUgLGtAj7J-qm1OVfXcDiJuSggAE9OU5f8vT6iNvy8tk7Qom5OYSCrq_4SRJIQTVFMPamc6b0xxx_pCyfuLkFJxICBOTOVmTDaGfbk May 26 14:12:07.827948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 14:12:07.827948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 14:12:07.827948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 14:12:07.827948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 14:12:07.827948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 14:12:07.827948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 14:12:07.827948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: 3fcd25a6c4574894a8270e3a43af782d May 26 14:12:07.827948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeTestJSON-1941238879 May 26 14:12:07.827948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 14:12:07.827948 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 14:12:07.829725 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/3fcd25a6c4574894a8270e3a43af782d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/3fcd25a6c4574894a8270e3a43af782d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/3fcd25a6c4574894a8270e3a43af782d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_3fcd25a6c4574894a8270e3a43af782d", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:12:07.829725 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeTestJSON-1941238879 May 26 14:12:07.829725 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 3fcd25a6c4574894a8270e3a43af782d May 26 14:12:07.829725 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1941238879 May 26 14:12:07.829725 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeTestJSON-1941238879-project May 26 14:12:07.829725 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 14:12:07.829725 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 14:12:07.829725 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: 18906ec812ac49b8ba849775215c4318 May 26 14:12:07.829725 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeTestJSON-1941238879-project May 26 14:12:07.829725 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: > May 26 14:12:07.829725 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Instance 73a8a362-d930-47d5-b449-fec49325ba7a could not be found. May 26 14:12:07.829725 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'id': '73a8a362-d930-47d5-b449-fec49325ba7a'} May 26 14:12:07.830697 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:12:07.830697 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:12:07.830697 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:12:07.830697 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:12:07.830697 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:12:07.830697 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:12:07.830697 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:12:07.830697 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:12:07.830697 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:12:07.830697 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:12:07.830697 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73a8a362-d930-47d5-b449-fec49325ba7a could not be found. May 26 14:12:07.830697 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:12:07.830697 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:12:07.830697 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:12:07.830697 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:12:07.830697 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:12:07.830697 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:12:07.830697 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:12:07.830697 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:12:07.830697 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:12:07.832329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:12:07.832329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 14:12:07.832329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 14:12:07.832329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 14:12:07.832329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 14:12:07.832329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:12:07.832329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:12:07.832329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:12:07.832329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:12:07.832329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73a8a362-d930-47d5-b449-fec49325ba7a could not be found. May 26 14:12:07.832329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:12:07.832329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:12:07.832329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:12:07.832329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:12:07.832329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:12:07.832329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:12:07.832329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:12:07.832329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:12:07.832329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73a8a362-d930-47d5-b449-fec49325ba7a could not be found. May 26 14:12:07.832329 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:12:07.834325 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7641c6ee-abc8-4fd9-8d99-08977bddb49e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Returning 404 to user: Instance 73a8a362-d930-47d5-b449-fec49325ba7a could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:12:07.834325 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7641c6ee-abc8-4fd9-8d99-08977bddb49e tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "DELETE /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 404 len: 111 microversion: 2.1 time: 0.030838 May 26 14:12:07.834325 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 663/1364] 10.222.0.91 () {58 vars in 1238 bytes} [Thu May 26 14:12:07 2022] DELETE /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:12:07.837915 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-df95c7ce-10ac-4ea0-be2c-7b2f3234691a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:12:07.838524 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-df95c7ce-10ac-4ea0-be2c-7b2f3234691a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] [instance: 73a8a362-d930-47d5-b449-fec49325ba7a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:12:07.844819 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-df95c7ce-10ac-4ea0-be2c-7b2f3234691a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:12:07.845893 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-df95c7ce-10ac-4ea0-be2c-7b2f3234691a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:12:07.846668 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-df95c7ce-10ac-4ea0-be2c-7b2f3234691a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:12:07.847097 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-df95c7ce-10ac-4ea0-be2c-7b2f3234691a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Lock "1cef31d3-1884-4927-928a-7d3f347ed78a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:12:07.859759 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-df95c7ce-10ac-4ea0-be2c-7b2f3234691a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] HTTP exception thrown: Instance 73a8a362-d930-47d5-b449-fec49325ba7a could not be found. May 26 14:12:07.861957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-df95c7ce-10ac-4ea0-be2c-7b2f3234691a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Request method failure captured: May 26 14:12:07.861957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a HTTP/1.1 May 26 14:12:07.861957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept: application/json May 26 14:12:07.861957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity May 26 14:12:07.861957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Connection: close May 26 14:12:07.861957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Length: 0 May 26 14:12:07.861957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Content-Type: application/json May 26 14:12:07.861957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Host: 10.222.0.91 May 26 14:12:07.861957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None May 26 14:12:07.861957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 May 26 14:12:07.861957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABij4kOqOz6Xfw7Mt9D1gY0ECU-gDuM-qtKf3oR9waq9lAk2Hb_DJG0CbV6EPrcPIzjzyWrt-djJUUgLGtAj7J-qm1OVfXcDiJuSggAE9OU5f8vT6iNvy8tk7Qom5OYSCrq_4SRJIQTVFMPamc6b0xxx_pCyfuLkFJxICBOTOVmTDaGfbk May 26 14:12:07.861957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Id: None May 26 14:12:07.861957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Domain-Name: None May 26 14:12:07.861957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed May 26 14:12:07.861957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True May 26 14:12:07.861957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default May 26 14:12:07.861957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default May 26 14:12:07.861957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Id: 3fcd25a6c4574894a8270e3a43af782d May 26 14:12:07.861957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeTestJSON-1941238879 May 26 14:12:07.861957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Role: member,reader May 26 14:12:07.861957 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Roles: member,reader May 26 14:12:07.863720 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/3fcd25a6c4574894a8270e3a43af782d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/3fcd25a6c4574894a8270e3a43af782d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/3fcd25a6c4574894a8270e3a43af782d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_3fcd25a6c4574894a8270e3a43af782d", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:12:07.863720 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeTestJSON-1941238879 May 26 14:12:07.863720 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 3fcd25a6c4574894a8270e3a43af782d May 26 14:12:07.863720 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1941238879 May 26 14:12:07.863720 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeTestJSON-1941238879-project May 26 14:12:07.863720 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default May 26 14:12:07.863720 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default May 26 14:12:07.863720 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Id: 18906ec812ac49b8ba849775215c4318 May 26 14:12:07.863720 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeTestJSON-1941238879-project May 26 14:12:07.863720 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: method: > May 26 14:12:07.863720 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: exception: Instance 73a8a362-d930-47d5-b449-fec49325ba7a could not be found. May 26 14:12:07.863720 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: action_args: {'id': '73a8a362-d930-47d5-b449-fec49325ba7a'} May 26 14:12:07.864549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:12:07.864549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:12:07.864549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:12:07.864549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:12:07.864549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:12:07.864549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:12:07.864549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:12:07.864549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:12:07.864549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:12:07.864549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:12:07.864549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73a8a362-d930-47d5-b449-fec49325ba7a could not be found. May 26 14:12:07.864549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:12:07.864549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:12:07.864549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:12:07.864549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:12:07.864549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:12:07.864549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:12:07.864549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:12:07.864549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:12:07.864549 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:12:07.865933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:12:07.865933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:12:07.865933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:12:07.865933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:12:07.865933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:12:07.865933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:12:07.865933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:12:07.865933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73a8a362-d930-47d5-b449-fec49325ba7a could not be found. May 26 14:12:07.865933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:12:07.865933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:12:07.865933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:12:07.865933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:12:07.865933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:12:07.865933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:12:07.865933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:12:07.865933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:12:07.865933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73a8a362-d930-47d5-b449-fec49325ba7a could not be found. May 26 14:12:07.865933 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi May 26 14:12:07.867150 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-df95c7ce-10ac-4ea0-be2c-7b2f3234691a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] Returning 404 to user: Instance 73a8a362-d930-47d5-b449-fec49325ba7a could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:12:07.867150 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-df95c7ce-10ac-4ea0-be2c-7b2f3234691a tempest-AttachVolumeTestJSON-1941238879 tempest-AttachVolumeTestJSON-1941238879-project] 10.222.0.91 "GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a" status: 404 len: 111 microversion: 2.1 time: 0.029363 May 26 14:12:07.867150 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 702/1365] 10.222.0.91 () {58 vars in 1235 bytes} [Thu May 26 14:12:07 2022] GET /compute/v2.1/servers/73a8a362-d930-47d5-b449-fec49325ba7a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:12:12.282320 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-32cfd40a-8559-46f0-9a85-4acd154306b1 tempest-VolumesGetTestJSON-485612990 tempest-VolumesGetTestJSON-485612990-project] Action: 'create', calling method: .version_select at 0x7f25a9bef1f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1260788515", "metadata": {"Type": "work"}}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:12:12.603194 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-32cfd40a-8559-46f0-9a85-4acd154306b1 tempest-VolumesGetTestJSON-485612990 tempest-VolumesGetTestJSON-485612990-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.448393 May 26 14:12:12.603887 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 664/1366] 10.222.0.91 () {60 vars in 1155 bytes} [Thu May 26 14:12:12 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 450 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 14:12:12.618196 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1a572ddb-476a-48ec-b95f-d03525c04c1f tempest-VolumesGetTestJSON-485612990 tempest-VolumesGetTestJSON-485612990-project] Calling method '.version_select at 0x7f25a4b149d0>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:12:12.674508 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1a572ddb-476a-48ec-b95f-d03525c04c1f tempest-VolumesGetTestJSON-485612990 tempest-VolumesGetTestJSON-485612990-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/20224374-1d10-41ef-8b9e-04ed527fcbc6" status: 200 len: 353 microversion: 2.1 time: 0.060387 May 26 14:12:12.675321 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 703/1367] 10.222.0.91 () {58 vars in 1244 bytes} [Thu May 26 14:12:12 2022] GET /compute/v2.1/os-volumes/20224374-1d10-41ef-8b9e-04ed527fcbc6 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:12:13.687707 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e72d39f6-110d-4c28-a1c3-4b6c2adeb4dc tempest-VolumesGetTestJSON-485612990 tempest-VolumesGetTestJSON-485612990-project] Calling method '.version_select at 0x7f25a9ba85e0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:12:13.737219 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e72d39f6-110d-4c28-a1c3-4b6c2adeb4dc tempest-VolumesGetTestJSON-485612990 tempest-VolumesGetTestJSON-485612990-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/20224374-1d10-41ef-8b9e-04ed527fcbc6" status: 200 len: 354 microversion: 2.1 time: 0.053733 May 26 14:12:13.737805 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 665/1368] 10.222.0.91 () {58 vars in 1244 bytes} [Thu May 26 14:12:13 2022] GET /compute/v2.1/os-volumes/20224374-1d10-41ef-8b9e-04ed527fcbc6 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:12:13.748902 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2a66e0dc-d4b8-4378-85f6-0ddc1d7e58b2 tempest-VolumesGetTestJSON-485612990 tempest-VolumesGetTestJSON-485612990-project] Calling method '.version_select at 0x7f25a49a55e0>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:12:13.796267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2a66e0dc-d4b8-4378-85f6-0ddc1d7e58b2 tempest-VolumesGetTestJSON-485612990 tempest-VolumesGetTestJSON-485612990-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/20224374-1d10-41ef-8b9e-04ed527fcbc6" status: 200 len: 354 microversion: 2.1 time: 0.051471 May 26 14:12:13.796839 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 704/1369] 10.222.0.91 () {58 vars in 1244 bytes} [Thu May 26 14:12:13 2022] GET /compute/v2.1/os-volumes/20224374-1d10-41ef-8b9e-04ed527fcbc6 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:12:13.812917 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-85f0859d-9ca7-4fdd-b9b7-5e6513a8beb2 tempest-VolumesGetTestJSON-485612990 tempest-VolumesGetTestJSON-485612990-project] Calling method '.version_select at 0x7f25a49980d0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:12:13.875066 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-85f0859d-9ca7-4fdd-b9b7-5e6513a8beb2 tempest-VolumesGetTestJSON-485612990 tempest-VolumesGetTestJSON-485612990-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/20224374-1d10-41ef-8b9e-04ed527fcbc6" status: 202 len: 0 microversion: 2.1 time: 0.065829 May 26 14:12:13.875683 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 666/1370] 10.222.0.91 () {58 vars in 1247 bytes} [Thu May 26 14:12:13 2022] DELETE /compute/v2.1/os-volumes/20224374-1d10-41ef-8b9e-04ed527fcbc6 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:12:13.884267 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-daaa0ab2-f24f-4134-9e01-e8fbc5730b65 tempest-VolumesGetTestJSON-485612990 tempest-VolumesGetTestJSON-485612990-project] Calling method '.version_select at 0x7f25a498fd30>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:12:13.944912 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-daaa0ab2-f24f-4134-9e01-e8fbc5730b65 tempest-VolumesGetTestJSON-485612990 tempest-VolumesGetTestJSON-485612990-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/20224374-1d10-41ef-8b9e-04ed527fcbc6" status: 200 len: 353 microversion: 2.1 time: 0.064588 May 26 14:12:13.945526 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 705/1371] 10.222.0.91 () {58 vars in 1244 bytes} [Thu May 26 14:12:13 2022] GET /compute/v2.1/os-volumes/20224374-1d10-41ef-8b9e-04ed527fcbc6 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:12:14.957808 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a99820cf-90cb-4313-84a5-314bcdd64e32 tempest-VolumesGetTestJSON-485612990 tempest-VolumesGetTestJSON-485612990-project] Calling method '.version_select at 0x7f25a9bc99d0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:12:14.984559 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-a99820cf-90cb-4313-84a5-314bcdd64e32 tempest-VolumesGetTestJSON-485612990 tempest-VolumesGetTestJSON-485612990-project] HTTP exception thrown: Volume 20224374-1d10-41ef-8b9e-04ed527fcbc6 could not be found. May 26 14:12:14.987008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a99820cf-90cb-4313-84a5-314bcdd64e32 tempest-VolumesGetTestJSON-485612990 tempest-VolumesGetTestJSON-485612990-project] Request method failure captured: May 26 14:12:14.987008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/os-volumes/20224374-1d10-41ef-8b9e-04ed527fcbc6 HTTP/1.1 May 26 14:12:14.987008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept: application/json May 26 14:12:14.987008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity May 26 14:12:14.987008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Connection: close May 26 14:12:14.987008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Length: 0 May 26 14:12:14.987008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Content-Type: application/json May 26 14:12:14.987008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Host: 10.222.0.91 May 26 14:12:14.987008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None May 26 14:12:14.987008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 May 26 14:12:14.987008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABij4q8K8ZOtO_SnFVSal5jIMB5j7_pi-YwRjBEfjQZSV8emjpno1uQ24-O_ohjvH6ukFe_qruNXLAzey9Acmpp-HdnN8KwstTNO-kB7r3mOGunxIRQZeJI3-6tyqj4shWK6P_3I3ANUOR_IVJYNNXyLPUBTmMwXjyE-Fvb66-WvdCT3oM May 26 14:12:14.987008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Id: None May 26 14:12:14.987008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Domain-Name: None May 26 14:12:14.987008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed May 26 14:12:14.987008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True May 26 14:12:14.987008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default May 26 14:12:14.987008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default May 26 14:12:14.987008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Id: db456be08cfa4c3b9ebf8c1e5bc396af May 26 14:12:14.987008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesGetTestJSON-485612990 May 26 14:12:14.987008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Role: member,reader May 26 14:12:14.987008 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Roles: member,reader May 26 14:12:14.988790 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/db456be08cfa4c3b9ebf8c1e5bc396af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/db456be08cfa4c3b9ebf8c1e5bc396af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/db456be08cfa4c3b9ebf8c1e5bc396af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:8080/v1/AUTH_db456be08cfa4c3b9ebf8c1e5bc396af", "adminURL": "http://10.222.0.91:8080"}]}] May 26 14:12:14.988790 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesGetTestJSON-485612990 May 26 14:12:14.988790 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Id: db456be08cfa4c3b9ebf8c1e5bc396af May 26 14:12:14.988790 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesGetTestJSON-485612990 May 26 14:12:14.988790 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesGetTestJSON-485612990-project May 26 14:12:14.988790 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default May 26 14:12:14.988790 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default May 26 14:12:14.988790 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Id: d3558eaf6ec04409819f6599a03fc5c0 May 26 14:12:14.988790 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesGetTestJSON-485612990-project May 26 14:12:14.988790 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: method: May 26 14:12:14.988790 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: exception: Volume 20224374-1d10-41ef-8b9e-04ed527fcbc6 could not be found. May 26 14:12:14.988790 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: action_args: {'id': '20224374-1d10-41ef-8b9e-04ed527fcbc6'} May 26 14:12:14.988790 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:12:14.990218 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:12:14.990218 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 14:12:14.990218 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 14:12:14.990218 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 14:12:14.990218 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 14:12:14.990218 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 14:12:14.990218 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 14:12:14.990218 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 14:12:14.990218 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 14:12:14.990218 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 14:12:14.990218 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 14:12:14.990218 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 14:12:14.990218 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 14:12:14.990218 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 14:12:14.990218 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 14:12:14.990218 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 20224374-1d10-41ef-8b9e-04ed527fcbc6 could not be found. (HTTP 404) (Request-ID: req-2a023ffd-9d82-403f-a03a-fbb06b7cd2a2) May 26 14:12:14.990218 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:12:14.990218 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:12:14.990218 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:12:14.992125 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:12:14.992125 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 14:12:14.992125 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 14:12:14.992125 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 14:12:14.992125 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 14:12:14.992125 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 14:12:14.992125 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 14:12:14.992125 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 14:12:14.992125 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 14:12:14.992125 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 14:12:14.992125 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 14:12:14.992125 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 14:12:14.992125 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 14:12:14.992125 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 14:12:14.992125 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 14:12:14.992125 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 14:12:14.992125 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 14:12:14.992125 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 14:12:14.992125 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 14:12:14.993820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 14:12:14.993820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 14:12:14.993820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 14:12:14.993820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 14:12:14.993820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 20224374-1d10-41ef-8b9e-04ed527fcbc6 could not be found. May 26 14:12:14.993820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:12:14.993820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:12:14.993820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:12:14.993820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:12:14.993820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:12:14.993820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:12:14.993820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:12:14.993820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:12:14.993820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 14:12:14.993820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 14:12:14.993820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:12:14.993820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:12:14.993820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 14:12:14.993820 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:12:14.995793 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 20224374-1d10-41ef-8b9e-04ed527fcbc6 could not be found. May 26 14:12:14.995793 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:12:14.995793 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:12:14.995793 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:12:14.995793 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:12:14.995793 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:12:14.995793 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:12:14.995793 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:12:14.995793 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:12:14.995793 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 20224374-1d10-41ef-8b9e-04ed527fcbc6 could not be found. May 26 14:12:14.995793 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi May 26 14:12:14.995793 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a99820cf-90cb-4313-84a5-314bcdd64e32 tempest-VolumesGetTestJSON-485612990 tempest-VolumesGetTestJSON-485612990-project] Returning 404 to user: Volume 20224374-1d10-41ef-8b9e-04ed527fcbc6 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:12:14.995793 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a99820cf-90cb-4313-84a5-314bcdd64e32 tempest-VolumesGetTestJSON-485612990 tempest-VolumesGetTestJSON-485612990-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/20224374-1d10-41ef-8b9e-04ed527fcbc6" status: 404 len: 109 microversion: 2.1 time: 0.034999 May 26 14:12:14.995793 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 667/1372] 10.222.0.91 () {58 vars in 1244 bytes} [Thu May 26 14:12:14 2022] GET /compute/v2.1/os-volumes/20224374-1d10-41ef-8b9e-04ed527fcbc6 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:12:52.189710 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:12:52.190417 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Thu May 26 14:12:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 14:12:58.479447 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:12:58.479992 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Thu May 26 14:12:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 14:14:50.011321 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:14:50.011905 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Thu May 26 14:14:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 14:14:55.656659 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:14:55.657364 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Thu May 26 14:14:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 14:14:59.372260 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:14:59.372822 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Thu May 26 14:14:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 14:16:07.094566 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:16:07.095298 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Thu May 26 14:16:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 14:16:12.200259 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:16:12.200807 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Thu May 26 14:16:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 14:16:18.488207 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:16:18.488888 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Thu May 26 14:16:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 14:18:10.019976 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:18:10.020653 dv-cinder-842130-1-iscsi devstack@n-api.service[117787]: Thu May 26 14:18:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 14:18:15.664792 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:18:15.665740 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Thu May 26 14:18:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 14:18:19.380660 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:18:19.381376 dv-cinder-842130-1-iscsi devstack@n-api.service[117788]: Thu May 26 14:18:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!